Towards an Algorithmic Statistics
Abstract
While Kolmogorov complexity is the accepted absolute measure of information content of an individual finite object, a similarly absolute notion is needed for the relation between an individual data sample and an individual model summarizing the information in the data, for example, a finite set where the data sample typically came from. The statistical theory based on such relations between individual objects can be called algorithmic statistics, in contrast to ordinary statistical theory that deals with relations between probabilistic ensembles. We develop a new algorithmic theory of typical statistic, sufficient statistic, and minimal suffcient statistic.
Cite
Text
Gács et al. "Towards an Algorithmic Statistics." International Conference on Algorithmic Learning Theory, 2000. doi:10.1007/3-540-40992-0_4Markdown
[Gács et al. "Towards an Algorithmic Statistics." International Conference on Algorithmic Learning Theory, 2000.](https://mlanthology.org/alt/2000/gacs2000alt-algorithmic/) doi:10.1007/3-540-40992-0_4BibTeX
@inproceedings{gacs2000alt-algorithmic,
title = {{Towards an Algorithmic Statistics}},
author = {Gács, Péter and Tromp, John and Vitányi, Paul M. B.},
booktitle = {International Conference on Algorithmic Learning Theory},
year = {2000},
pages = {41-55},
doi = {10.1007/3-540-40992-0_4},
url = {https://mlanthology.org/alt/2000/gacs2000alt-algorithmic/}
}