A biological model of nonlinear dimensionality reduction
Preprint
Abstract
Obtaining appropriate low-dimensional representations from high-dimensional sensory inputs in an unsupervised manner is essential for straightforward downstream processing. Although nonlinear dimensionality reduction methods such as t-distributed stochastic neighbor embedding (t-SNE) have been developed, their implementation in simple biological circuits remains unclear. Here, we develop a biologically plausible dimensionality reduction algorithm compatible with t-SNE, which utilizes a simple three-layer feedforward network mimicking the Drosophila olfactory circuit. The proposed learning rule, described as three-factor Hebbian plasticity, is effective for datasets such as entangled rings and MNIST, comparable to t-SNE. We further show that the algorithm could be working in olfactory circuits in Drosophila by analyzing the multiple experimental data in previous studies. We finally suggest that the algorithm is also beneficial for association learning between inputs and rewards, allowing the generalization of these associations to other inputs not yet associated with rewards.Keywords
All Related Versions
- Published version: Science Advances, 11 (6), eadp9048.
This publication has 55 references indexed in Scilit:
- Learning beyond sensations: How dreams organize neuronal representationsNeuroscience & Biobehavioral Reviews, 2023
- Computational role of sleep in memory reorganizationCurrent Opinion in Neurobiology, 2023
- Dopaminergic neurons dynamically update sensory values during olfactory maneuverCell Reports, 2023
- Neural population geometry: An approach for understanding biological and artificial neural networksCurrent Opinion in Neurobiology, 2021
- Neuronal mechanisms underlying innate and learned olfactory processing in DrosophilaCurrent Opinion in Insect Science, 2019
- Learning with three factors: modulating Hebbian plasticity with errorsCurrent Opinion in Neurobiology, 2017
- The search for true numbers of neurons and glial cells in the human brain: A review of 150 years of cell countingJournal of Comparative Neurology, 2016
- Why neurons mix: high dimensionality for higher cognitionCurrent Opinion in Neurobiology, 2016
- How Does the Brain Solve Visual Object Recognition?Neuron, 2012
- Coding of Odors by a Receptor RepertoireCell, 2006