Learning from Incomplete Data with Infinite Imputations
Abstract
We address the problem of learning decision functions from training data in which some attribute values are unobserved. This problem can arise for instance, when training data is aggregated from multiple sources, and some sources record only a subset of attributes. We derive a joint optimization problem for the final classifier in which the distribution governing the missing values is a free parameter. We show that the optimal solution concentrates the density mass on finitely many atoms, and provide a corresponding algorithm for learning from incomplete data. We report on empirical results on benchmark data, and on the email spam application that motivates the problem setting.
Cite
Text
Dick et al. "Learning from Incomplete Data with Infinite Imputations." International Conference on Machine Learning, 2008. doi:10.1145/1390156.1390186Markdown
[Dick et al. "Learning from Incomplete Data with Infinite Imputations." International Conference on Machine Learning, 2008.](https://mlanthology.org/icml/2008/dick2008icml-learning/) doi:10.1145/1390156.1390186BibTeX
@inproceedings{dick2008icml-learning,
title = {{Learning from Incomplete Data with Infinite Imputations}},
author = {Dick, Uwe and Haider, Peter and Scheffer, Tobias},
booktitle = {International Conference on Machine Learning},
year = {2008},
pages = {232-239},
doi = {10.1145/1390156.1390186},
url = {https://mlanthology.org/icml/2008/dick2008icml-learning/}
}