Oscillator Associative Memories Facilitate High-Capacity, Compositional Inference
Abstract
We introduce a high-capacity associative memory capable of factorizing compositional representations of variables. The proposed approach is implemented as a continuous-time oscillator neural network. By performing factorization with a continuous-time dynamical system, the proposed Factorizing Oscillator Associative Memory (FOAM) provides efficient solutions to computationally hard problems such as inference in compositional representations and combinatorial optimization. We demonstrate favorable performance compared to existing approaches to factorization, improved interpretability, and relevance to standard tasks such as the subset sum problem.
Cite
Text
Kymn et al. "Oscillator Associative Memories Facilitate High-Capacity, Compositional Inference." ICLR 2025 Workshops: NFAM, 2025.Markdown
[Kymn et al. "Oscillator Associative Memories Facilitate High-Capacity, Compositional Inference." ICLR 2025 Workshops: NFAM, 2025.](https://mlanthology.org/iclrw/2025/kymn2025iclrw-oscillator/)BibTeX
@inproceedings{kymn2025iclrw-oscillator,
title = {{Oscillator Associative Memories Facilitate High-Capacity, Compositional Inference}},
author = {Kymn, Christopher and Bybee, Connor and Yun, Zeyu and Kleyko, Denis and Olshausen, Bruno},
booktitle = {ICLR 2025 Workshops: NFAM},
year = {2025},
url = {https://mlanthology.org/iclrw/2025/kymn2025iclrw-oscillator/}
}