Back to Search Start Over

The geometry of robustness in spiking neural networks.

Authors :
Calaim, Nuno
Dehmelt, Florian A.
Gonçalves, Pedro J.
Machens, Christian K.
Source :
eLife. 7/22/2022, p1-39. 39p.
Publication Year :
2022

Abstract

Neural systems are remarkably robust against various perturbations, a phenomenon that still requires a clear explanation. Here, we graphically illustrate how neural networks can become robust. We study spiking networks that generate low-dimensional representations, and we show that the neurons' subthreshold voltages are confined to a convex region in a lower-dimensional voltage subspace, which we call a 'bounding box'. Any changes in network parameters (such as number of neurons, dimensionality of inputs, firing thresholds, synaptic weights, or transmission delays) can all be understood as deformations of this bounding box. Using these insights, we show that functionality is preserved as long as perturbations do not destroy the integrity of the bounding box. We suggest that the principles underlying robustness in these networks -- low-dimensional representations, heterogeneity of tuning, and precise negative feedback -- may be key to understanding the robustness of neural systems at the circuit level. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
2050084X
Database :
Academic Search Index
Journal :
eLife
Publication Type :
Academic Journal
Accession number :
158220921
Full Text :
https://doi.org/10.7554/eLife.73276