Back to Search
Start Over
Perturbation of Spike Timing Benefits Neural Network Performance on Similarity Search.
- Source :
-
IEEE transactions on neural networks and learning systems [IEEE Trans Neural Netw Learn Syst] 2022 Sep; Vol. 33 (9), pp. 4361-4372. Date of Electronic Publication: 2022 Aug 31. - Publication Year :
- 2022
-
Abstract
- Perturbation has a positive effect, as it contributes to the stability of neural systems through adaptation and robustness. For example, deep reinforcement learning generally engages in exploratory behavior by injecting noise into the action space and network parameters. It can consistently increase the agent's exploration ability and lead to richer sets of behaviors. Evolutionary strategies also apply parameter perturbations, which makes network architecture robust and diverse. Our main concern is whether the notion of synaptic perturbation introduced in a spiking neural network (SNN) is biologically relevant or if novel frameworks and components are desired to account for the perturbation properties of artificial neural systems. In this work, we first review part of the locality-sensitive hashing (LSH) of similarity search, the FLY algorithm, as recently published in Science, and propose an improved architecture, time-shifted spiking LSH (TS-SLSH), with the consideration of temporal perturbations of the firing moments of spike pulses. Experiment results show promising performance of the proposed method and demonstrate its generality to various spiking neuron models. Therefore, we expect temporal perturbation to play an active role in SNN performance.
- Subjects :
- Algorithms
Neurons physiology
Models, Neurological
Neural Networks, Computer
Subjects
Details
- Language :
- English
- ISSN :
- 2162-2388
- Volume :
- 33
- Issue :
- 9
- Database :
- MEDLINE
- Journal :
- IEEE transactions on neural networks and learning systems
- Publication Type :
- Academic Journal
- Accession number :
- 33606643
- Full Text :
- https://doi.org/10.1109/TNNLS.2021.3056694