Category-Theoretical and Topos-Theoretical Frameworks in Machine Learning: A Survey
Preprint
Abstract
In this survey, we provide an overview of category theory-derived machine learning from four mainstream perspectives: gradient-based learning, probability-based learning, invariance and equivalence-based learning, and topos-based learning. For the first three topics, we primarily review research in the past five years, updating and expanding on the previous survey by Shiebler et al.. The fourth topic, which delves into higher category theory, particularly topos theory, is surveyed for the first time in this paper. In certain machine learning methods, the compositionality of functors plays a vital role, prompting the development of specific categorical frameworks. However, when considering how the global properties of a network reflect in local structures and how geometric properties are expressed with logic, the topos structure becomes particularly significant and profound.Keywords
All Related Versions
This publication has 59 references indexed in Scilit:
- Categorical Foundations of Gradient-Based Learning2022
- Persistent Homology in Data Science2021
- Topological Methods for Unsupervised Learning2019
- A Topos-Based Approach to Building Language OntologiesLecture Notes in Computer Science, 2019
- Relational Reasoning for Markov Chains in a Probabilistic Guarded Lambda Calculus2018
- Random Measures, Theory and Applications2017
- $A_\infty $ A ∞ -persistenceApplicable Algebra in Engineering, Communication and Computing, 2014
- A New Foundation for Representation in Cognitive and Brain Science2014
- Grothendieck Toposes as Unifying ‘Bridges’: A Mathematical Morphogenesis2012
- A categorical approach to probability theory1982