Heteroscedastic Probabilistic Linear Discriminant Analysis with Semi-Supervised Extension
Abstract
Linear discriminant analysis (LDA) is a commonly used method for dimensionality reduction. Despite its successes, it has limitations under some situations, including the small sample size problem, the homoscedasticity assumption that different classes have the same Gaussian distribution, and its inability to produce probabilistic output and handle missing data. In this paper, we propose a semi-supervised and heteroscedastic extension of probabilistic LDA, called S^2HPLDA, which aims at overcoming all these limitations under a common principled framework. Moreover, we apply automatic relevance determination to determine the required dimensionality of the low-dimensional space for dimensionality reduction. We empirically compare our method with several related probabilistic subspace methods on some face and object databases. Very promising results are obtained from the experiments showing the effectiveness of our proposed method.
Cite
Text
Zhang and Yeung. "Heteroscedastic Probabilistic Linear Discriminant Analysis with Semi-Supervised Extension." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2009. doi:10.1007/978-3-642-04174-7_39Markdown
[Zhang and Yeung. "Heteroscedastic Probabilistic Linear Discriminant Analysis with Semi-Supervised Extension." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2009.](https://mlanthology.org/ecmlpkdd/2009/zhang2009ecmlpkdd-heteroscedastic/) doi:10.1007/978-3-642-04174-7_39BibTeX
@inproceedings{zhang2009ecmlpkdd-heteroscedastic,
title = {{Heteroscedastic Probabilistic Linear Discriminant Analysis with Semi-Supervised Extension}},
author = {Zhang, Yu and Yeung, Dit-Yan},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2009},
pages = {602-616},
doi = {10.1007/978-3-642-04174-7_39},
url = {https://mlanthology.org/ecmlpkdd/2009/zhang2009ecmlpkdd-heteroscedastic/}
}