Empirical Entropy Manipulation for Real-World Problems
Abstract
No finite sample is sufficient to determine the density, and therefore the entropy, of a signal directly. Some assumption about either the functional form of the density or about its smoothness is necessary. Both amount to a prior over the space of possible density functions. By far the most common approach is to assume that the density has a parametric form.
Cite
Text
Viola et al. "Empirical Entropy Manipulation for Real-World Problems." Neural Information Processing Systems, 1995.Markdown
[Viola et al. "Empirical Entropy Manipulation for Real-World Problems." Neural Information Processing Systems, 1995.](https://mlanthology.org/neurips/1995/viola1995neurips-empirical/)BibTeX
@inproceedings{viola1995neurips-empirical,
title = {{Empirical Entropy Manipulation for Real-World Problems}},
author = {Viola, Paul A. and Schraudolph, Nicol N. and Sejnowski, Terrence J.},
booktitle = {Neural Information Processing Systems},
year = {1995},
pages = {851-857},
url = {https://mlanthology.org/neurips/1995/viola1995neurips-empirical/}
}