A Group-Theoretic Approach to Computational Abstraction: Symmetry-Driven Hierarchical Clustering
Abstract
Humans' abstraction ability plays a key role in concept learning and knowledge discovery. This theory paper presents the mathematical formulation for computationally emulating human-like abstractions---computational abstraction---and abstraction processes developed hierarchically from innate priors like symmetries. We study the nature of abstraction via a group-theoretic approach, formalizing and practically computing abstractions as symmetry-driven hierarchical clustering. Compared to data-driven clustering like k-means or agglomerative clustering (a chain), our abstraction model is data-free, feature-free, similarity-free, and globally hierarchical (a lattice). This paper also serves as a theoretical generalization of several existing works. These include generalizing Shannon's information lattice, specialized algorithms for certain symmetry-induced clusterings, as well as formalizing knowledge discovery applications such as learning music theory from scores and chemistry laws from molecules. We consider computational abstraction as a first step towards a principled and cognitive way of achieving human-level concept learning and knowledge discovery.
Cite
Text
Yu et al. "A Group-Theoretic Approach to Computational Abstraction: Symmetry-Driven Hierarchical Clustering." Journal of Machine Learning Research, 2023.Markdown
[Yu et al. "A Group-Theoretic Approach to Computational Abstraction: Symmetry-Driven Hierarchical Clustering." Journal of Machine Learning Research, 2023.](https://mlanthology.org/jmlr/2023/yu2023jmlr-grouptheoretic/)BibTeX
@article{yu2023jmlr-grouptheoretic,
title = {{A Group-Theoretic Approach to Computational Abstraction: Symmetry-Driven Hierarchical Clustering}},
author = {Yu, Haizi and Mineyev, Igor and Varshney, Lav R.},
journal = {Journal of Machine Learning Research},
year = {2023},
pages = {1-61},
volume = {24},
url = {https://mlanthology.org/jmlr/2023/yu2023jmlr-grouptheoretic/}
}