Incomplete-Data Classification Using Logistic Regression

Abstract

A logistic regression classification algorithm is developed for problems in which the feature vectors may be missing data (features). Single or multiple imputation for the missing data is avoided by performing analytic integration with an estimated conditional density function (conditioned on the non-missing data). Conditional density functions are estimated using a Gaussian mixture model (GMM), with parameter estimation performed using both expectation maximization (EM) and Variational Bayesian EM (VB-EM). Using widely available real data, we demonstrate the general advantage of the VB-EM GMM estimation for handling incomplete data, vis-à-vis the EM algorithm. Moreover, it is demonstrated that the approach proposed here is generally superior to standard imputation procedures.

Cite

Text

Williams et al. "Incomplete-Data Classification Using Logistic Regression." International Conference on Machine Learning, 2005. doi:10.1145/1102351.1102474

Markdown

[Williams et al. "Incomplete-Data Classification Using Logistic Regression." International Conference on Machine Learning, 2005.](https://mlanthology.org/icml/2005/williams2005icml-incomplete/) doi:10.1145/1102351.1102474

BibTeX

@inproceedings{williams2005icml-incomplete,
  title     = {{Incomplete-Data Classification Using Logistic Regression}},
  author    = {Williams, David and Liao, Xuejun and Xue, Ya and Carin, Lawrence},
  booktitle = {International Conference on Machine Learning},
  year      = {2005},
  pages     = {972-979},
  doi       = {10.1145/1102351.1102474},
  url       = {https://mlanthology.org/icml/2005/williams2005icml-incomplete/}
}