Never-Ending Learning

Abstract

Whereas people learn many different types of knowledge from diverse experiences over many years, most current machine learning systems acquire just a single function or data model from just a single data set. We propose a never-ending learning paradigm for machine learning, to better reflect the more ambitious and encompassing type of learning performed by humans. As a case study, we describe the Never-Ending Language Learner (NELL), which achieves some of the desired properties of a never-ending learner, and we discuss lessons learned. NELL has been learning to read the web 24 hours/day since January 2010, and so far has acquired a knowledge base with over 80 million confidence-weighted beliefs (e.g., servedWith(tea, biscuits)). NELL has also learned millions of features and parameters that enable it to read these beliefs from the web. Additionally, it has learned to reason over these beliefs to infer new beliefs, and is able to extend its ontology by synthesizing new relational predicates. NELL can be tracked online at http://rtw.ml.cmu.edu, and followed on Twitter at @CMUNELL.

Cite

Text

Mitchell et al. "Never-Ending Learning." AAAI Conference on Artificial Intelligence, 2015. doi:10.1609/AAAI.V29I1.9498

Markdown

[Mitchell et al. "Never-Ending Learning." AAAI Conference on Artificial Intelligence, 2015.](https://mlanthology.org/aaai/2015/mitchell2015aaai-never/) doi:10.1609/AAAI.V29I1.9498

BibTeX

@inproceedings{mitchell2015aaai-never,
  title     = {{Never-Ending Learning}},
  author    = {Mitchell, Tom M. and Cohen, William W. and Jr., Estevam R. Hruschka and Talukdar, Partha Pratim and Betteridge, Justin and Carlson, Andrew and Mishra, Bhavana Dalvi and Gardner, Matthew and Kisiel, Bryan and Krishnamurthy, Jayant and Lao, Ni and Mazaitis, Kathryn and Mohamed, Thahir and Nakashole, Ndapandula and Platanios, Emmanouil A. and Ritter, Alan and Samadi, Mehdi and Settles, Burr and Wang, Richard C. and Wijaya, Derry and Gupta, Abhinav and Chen, Xinlei and Saparov, Abulhair and Greaves, Malcolm and Welling, Joel},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2015},
  pages     = {2302-2310},
  doi       = {10.1609/AAAI.V29I1.9498},
  url       = {https://mlanthology.org/aaai/2015/mitchell2015aaai-never/}
}