A Group-Theoretic Approach to Computational Abstraction: Symmetry-Driven Hierarchical Clustering

Abstract

Humans' abstraction ability plays a key role in concept learning and knowledge discovery. This theory paper presents the mathematical formulation for computationally emulating human-like abstractions---computational abstraction---and abstraction processes developed hierarchically from innate priors like symmetries. We study the nature of abstraction via a group-theoretic approach, formalizing and practically computing abstractions as symmetry-driven hierarchical clustering. Compared to data-driven clustering like k-means or agglomerative clustering (a chain), our abstraction model is data-free, feature-free, similarity-free, and globally hierarchical (a lattice). This paper also serves as a theoretical generalization of several existing works. These include generalizing Shannon's information lattice, specialized algorithms for certain symmetry-induced clusterings, as well as formalizing knowledge discovery applications such as learning music theory from scores and chemistry laws from molecules. We consider computational abstraction as a first step towards a principled and cognitive way of achieving human-level concept learning and knowledge discovery.

Cite

Text

Yu et al. "A Group-Theoretic Approach to Computational Abstraction: Symmetry-Driven Hierarchical Clustering." Journal of Machine Learning Research, 2023.

Markdown

[Yu et al. "A Group-Theoretic Approach to Computational Abstraction: Symmetry-Driven Hierarchical Clustering." Journal of Machine Learning Research, 2023.](https://mlanthology.org/jmlr/2023/yu2023jmlr-grouptheoretic/)

BibTeX

@article{yu2023jmlr-grouptheoretic,
  title     = {{A Group-Theoretic Approach to Computational Abstraction: Symmetry-Driven Hierarchical Clustering}},
  author    = {Yu, Haizi and Mineyev, Igor and Varshney, Lav R.},
  journal   = {Journal of Machine Learning Research},
  year      = {2023},
  pages     = {1-61},
  volume    = {24},
  url       = {https://mlanthology.org/jmlr/2023/yu2023jmlr-grouptheoretic/}
}