Back to Search Start Over

Binary‐Stochasticity‐Enabled Highly Efficient Neuromorphic Deep Learning Achieves Better‐than‐Software Accuracy.

Authors :
Li, Yang
Wang, Wei
Wang, Ming
Dou, Chunmeng
Ma, Zhengyu
Zhou, Huihui
Zhang, Peng
Lepri, Nicola
Zhang, Xumeng
Luo, Qing
Xu, Xiaoxin
Yang, Guanhua
Zhang, Feng
Li, Ling
Ielmini, Daniele
Liu, Ming
Source :
Advanced Intelligent Systems (2640-4567); Jan2024, Vol. 6 Issue 1, p1-15, 15p
Publication Year :
2024

Abstract

In this work, the requirement of using high‐precision (HP) signals is lifted and the circuits for implementing deep learning algorithms in memristor‐based hardware are simplified. The use of HP signals is required by the backpropagation learning algorithm since the gradient descent learning rule relies on the chain product of partial derivatives. However, it is both challenging and biologically implausible to implement such an HP algorithm in noisy and analog memristor‐based hardware systems. Herein, it is demonstrated that the requirement for HP signals handling is not necessary and more efficient deep learning can be achieved when using a binary stochastic learning algorithm. The new algorithm proposed in this work modifies elementary neural network operations, which improves energy efficiency by two orders of magnitude compared to traditional memristor‐based hardware and three orders of magnitude compared to complementary metal–oxide–semiconductor‐based hardware. It also provides better accuracy in pattern recognition tasks than the HP learning algorithm benchmarks. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
26404567
Volume :
6
Issue :
1
Database :
Complementary Index
Journal :
Advanced Intelligent Systems (2640-4567)
Publication Type :
Academic Journal
Accession number :
174935976
Full Text :
https://doi.org/10.1002/aisy.202300399