The Capacity of Modern Hopfield Networks Under the Data Manifold Hypothesis
Abstract
We generalize the computation of the capacity of exponential Hopfield model from Lucibello and Mézard (2024) to more generic pattern ensembles, including binary patterns and patterns generated from a hidden manifold model.
Cite
Text
Achilli et al. "The Capacity of Modern Hopfield Networks Under the Data Manifold Hypothesis." ICLR 2025 Workshops: NFAM, 2025.Markdown
[Achilli et al. "The Capacity of Modern Hopfield Networks Under the Data Manifold Hypothesis." ICLR 2025 Workshops: NFAM, 2025.](https://mlanthology.org/iclrw/2025/achilli2025iclrw-capacity/)BibTeX
@inproceedings{achilli2025iclrw-capacity,
title = {{The Capacity of Modern Hopfield Networks Under the Data Manifold Hypothesis}},
author = {Achilli, Beatrice and Ambrogioni, Luca and Lucibello, Carlo and Mezard, Marc and Ventura, Enrico},
booktitle = {ICLR 2025 Workshops: NFAM},
year = {2025},
url = {https://mlanthology.org/iclrw/2025/achilli2025iclrw-capacity/}
}