Proliferation of non-linear excitations in the piecewise-linear perceptron
Open Access
- 21 January 2021
- journal article
- research article
- Published by Stichting SciPost in SciPost Physics
- Vol. 10 (1) , 013
Abstract
We investigate the properties of local minima of the energy landscape of a continuous non-convex optimization problem, the spherical perceptron with piecewise linear cost function and show that they are critical, marginally stable and displaying a set of pseudogaps, singularities and non-linear excitations whose properties appear to be in the same universality class of jammed packings of hard spheres. The piecewise linear perceptron problem appears as an evolution of the purely linear perceptron optimization problem that has been recently investigated in [1]. Its cost function contains two non-analytic points where the derivative has a jump. Correspondingly, in the non-convex/glassy phase, these two points give rise to four pseudogaps in the force distribution and this induces four power laws in the gap distribution as well. In addition one can define an extended notion of isostaticity and show that local minima appear again to be isostatic in this phase. We believe that our results generalize naturally to more complex cases with a proliferation of non-linear excitations as the number of non-analytic points in the cost function is increased.Keywords
All Related Versions
Funding Information
- Agence Nationale de la Recherche (ANR-10-LABX-0039-PALM)
- Simons Foundation (454941)
This publication has 23 references indexed in Scilit:
- Critical energy landscape of linear soft spheresSciPost Physics, 2020
- Theory of Simple Glasses2019
- Critical Jammed Phase of the Linear PerceptronPhysical Review Letters, 2019
- Can a Large Packing be Assembled from Smaller Ones?Physical Review Letters, 2019
- Two Diverging Length Scales in the Structure of Jammed PackingsPhysical Review Letters, 2018
- Glass and Jamming Transitions: From Exact Results to Finite-Dimensional DescriptionsAnnual Review of Condensed Matter Physics, 2017
- Marginal Stability in Structural, Spin, and Electron GlassesAnnual Review of Condensed Matter Physics, 2015
- Finite-Size Scaling at the Jamming TransitionPhysical Review Letters, 2012
- The Jamming Transition and the Marginally Jammed SolidAnnual Review of Condensed Matter Physics, 2010
- The space of interactions in neural network modelsJournal of Physics A: General Physics, 1988