Continual Learning with Knowledge Transfer for Sentiment Classification

Abstract

This paper studies continual learning (CL) for sentiment classification (SC). In this setting, the CL system learns a sequence of SC tasks incrementally in a neural network, where each task builds a classifier to classify the sentiment of reviews of a particular product category or domain. Two natural questions are: Can the system transfer the knowledge learned in the past from the previous tasks to the new task to help it learn a better model for the new task? And, can old models for previous tasks be improved in the process as well? This paper proposes a novel technique called KAN to achieve these objectives. KAN can markedly improve the SC accuracy of both the new task and the old tasks via forward and backward knowledge transfer. The effectiveness of KAN is demonstrated through extensive experiments.

Cite

Text

Ke et al. "Continual Learning with Knowledge Transfer for Sentiment Classification." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2020. doi:10.1007/978-3-030-67664-3_41

Markdown

[Ke et al. "Continual Learning with Knowledge Transfer for Sentiment Classification." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2020.](https://mlanthology.org/ecmlpkdd/2020/ke2020ecmlpkdd-continual/) doi:10.1007/978-3-030-67664-3_41

BibTeX

@inproceedings{ke2020ecmlpkdd-continual,
  title     = {{Continual Learning with Knowledge Transfer for Sentiment Classification}},
  author    = {Ke, Zixuan and Liu, Bing and Wang, Hao and Shu, Lei},
  booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
  year      = {2020},
  pages     = {683-698},
  doi       = {10.1007/978-3-030-67664-3_41},
  url       = {https://mlanthology.org/ecmlpkdd/2020/ke2020ecmlpkdd-continual/}
}