Rate Distortion Function in the Spin Glass State: A Toy Model
Abstract
We applied statistical mechanics to an inverse problem of linear mapping to investigate the physics of optimal lossy compressions. We used the replica symmetry breaking technique with a toy model to demonstrate Shannon’s result. The rate distortion function, which is widely known as the theoretical limit of the compression with a fidelity criterion, is derived. Numerical study shows that sparse constructions of the model provide suboptimal compressions.
Cite
Text
Murayama and Okada. "Rate Distortion Function in the Spin Glass State: A Toy Model." Neural Information Processing Systems, 2002.Markdown
[Murayama and Okada. "Rate Distortion Function in the Spin Glass State: A Toy Model." Neural Information Processing Systems, 2002.](https://mlanthology.org/neurips/2002/murayama2002neurips-rate/)BibTeX
@inproceedings{murayama2002neurips-rate,
title = {{Rate Distortion Function in the Spin Glass State: A Toy Model}},
author = {Murayama, Tatsuto and Okada, Masato},
booktitle = {Neural Information Processing Systems},
year = {2002},
pages = {423-430},
url = {https://mlanthology.org/neurips/2002/murayama2002neurips-rate/}
}