Parameter Learning of Bayesian Network Classifiers Under Computational Constraints
Abstract
We consider online learning of Bayesian network classifiers (BNCs) with reduced-precision parameters, i.e. the conditional-probability tables parameterizing the BNCs are represented by low bit-width fixed-point numbers. In contrast to previous work, we analyze the learning of these parameters using reduced-precision arithmetic only which is important for computationally constrained platforms, e.g. embedded- and ambient-systems, as well as power-aware systems. This requires specialized algorithms since naive implementations of the projection for ensuring the sum-to-one constraint of the parameters in gradient-based learning are not sufficiently accurate. In particular, we present generative and discriminative learning algorithms for BNCs relying only on reduced-precision arithmetic. For several standard benchmark datasets, these algorithms achieve classification-rate performance close to that of BNCs with parameters learned by conventional algorithms using double-precision floating-point arithmetic. Our results facilitate the utilization of BNCs in the foresaid systems.
Cite
Text
Tschiatschek and Pernkopf. "Parameter Learning of Bayesian Network Classifiers Under Computational Constraints." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2015. doi:10.1007/978-3-319-23528-8_6Markdown
[Tschiatschek and Pernkopf. "Parameter Learning of Bayesian Network Classifiers Under Computational Constraints." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2015.](https://mlanthology.org/ecmlpkdd/2015/tschiatschek2015ecmlpkdd-parameter/) doi:10.1007/978-3-319-23528-8_6BibTeX
@inproceedings{tschiatschek2015ecmlpkdd-parameter,
title = {{Parameter Learning of Bayesian Network Classifiers Under Computational Constraints}},
author = {Tschiatschek, Sebastian and Pernkopf, Franz},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2015},
pages = {86-101},
doi = {10.1007/978-3-319-23528-8_6},
url = {https://mlanthology.org/ecmlpkdd/2015/tschiatschek2015ecmlpkdd-parameter/}
}