Self-Organizing Incremental Neural Networks for Continual Learning
Abstract
Continual learning systems can adapt to new tasks, changes in data distributions, and new information that becomes incrementally available over time. The key challenge for such systems is how to mitigate catastrophic forgetting, i.e., how to prevent the loss of previously learned knowledge when new tasks need to be solved. In our research, we investigate self-organizing incremental neural networks (SOINN) for continual learning from both stationary and non-stationary data. We have developed a new algorithm, SOINN+, that learns to forget irrelevant nodes and edges and is robust to noise.
Cite
Text
Wiwatcharakoses and Berrar. "Self-Organizing Incremental Neural Networks for Continual Learning." International Joint Conference on Artificial Intelligence, 2019. doi:10.24963/IJCAI.2019/927Markdown
[Wiwatcharakoses and Berrar. "Self-Organizing Incremental Neural Networks for Continual Learning." International Joint Conference on Artificial Intelligence, 2019.](https://mlanthology.org/ijcai/2019/wiwatcharakoses2019ijcai-self/) doi:10.24963/IJCAI.2019/927BibTeX
@inproceedings{wiwatcharakoses2019ijcai-self,
title = {{Self-Organizing Incremental Neural Networks for Continual Learning}},
author = {Wiwatcharakoses, Chayut and Berrar, Daniel},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2019},
pages = {6476-6477},
doi = {10.24963/IJCAI.2019/927},
url = {https://mlanthology.org/ijcai/2019/wiwatcharakoses2019ijcai-self/}
}