Back to Search
Start Over
Deep reinforcement learning with significant multiplications inference.
- Source :
-
Scientific reports [Sci Rep] 2023 Nov 27; Vol. 13 (1), pp. 20865. Date of Electronic Publication: 2023 Nov 27. - Publication Year :
- 2023
-
Abstract
- We propose a sparse computation method for optimizing the inference of neural networks in reinforcement learning (RL) tasks. Motivated by the processing abilities of the brain, this method combines simple neural network pruning with a delta-network algorithm to account for the input data correlations. The former mimics neuroplasticity by eliminating inefficient connections; the latter makes it possible to update neuron states only when their changes exceed a certain threshold. This combination significantly reduces the number of multiplications during the neural network inference for fast neuromorphic computing. We tested the approach in popular deep RL tasks, yielding up to a 100-fold reduction in the number of required multiplications without substantial performance loss (sometimes, the performance even improved).<br /> (© 2023. The Author(s).)
Details
- Language :
- English
- ISSN :
- 2045-2322
- Volume :
- 13
- Issue :
- 1
- Database :
- MEDLINE
- Journal :
- Scientific reports
- Publication Type :
- Academic Journal
- Accession number :
- 38012259
- Full Text :
- https://doi.org/10.1038/s41598-023-47245-y