1. Digital Implementation of Oscillatory Neural Network for Image Recognition Application
- Author
-
Manuel Jimenez, Thierry Gil, Aida Todri-Sanial, María J. Avellido, Théophile Gonos, Madeleine Abernot, Tanguy Hardelin, Bernabe Linares-Barranco, Juan Núñez, Smart Integrated Electronic Systems (SmartIES), Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier (LIRMM), Centre National de la Recherche Scientifique (CNRS)-Université de Montpellier (UM)-Centre National de la Recherche Scientifique (CNRS)-Université de Montpellier (UM), Centre National de la Recherche Scientifique (CNRS)-Université de Montpellier (UM), Instituto de Microelectrónica de Sevilla (IMSE-CNM), Universidad de Sevilla-Centro Nacional de Microelectronica [Spain] (CNM)-Consejo Superior de Investigaciones Científicas [Madrid] (CSIC), A.I.Mergence [Paris], European Project: 871501,H2020-EU.2.1.1. - INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT),H2020-ICT-2019-2,NeurONN(2020), Université de Montpellier (UM)-Centre National de la Recherche Scientifique (CNRS)-Université de Montpellier (UM)-Centre National de la Recherche Scientifique (CNRS), Université de Montpellier (UM)-Centre National de la Recherche Scientifique (CNRS), Instituto de Microelectrónica de Sevilla (IMSE-CNM CSIC), Centro Nacional de Microelectronica [Spain] (CNM)-Consejo Superior de Investigaciones Científicas [Madrid] (CSIC), Universidad de Sevilla / University of Sevilla-Centro Nacional de Microelectronica [Spain] (CNM)-Consejo Superior de Investigaciones Científicas [Madrid] (CSIC), Universidad de Sevilla. Departamento de Electrónica y Electromagnetismo, and European Union (UE). H2020
- Subjects
Learning rules ,[INFO.INFO-AR]Computer Science [cs]/Hardware Architecture [cs.AR] ,Artificial intelligence ,Auto-associative memory ,FPGA implementations ,Computer science ,Neurosciences. Biological psychiatry. Neuropsychiatry ,02 engineering and technology ,[INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE] ,01 natural sciences ,Autoassociative memory ,[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] ,Pattern recognition ,0103 physical sciences ,0202 electrical engineering, electronic engineering, information engineering ,[SPI.NANO]Engineering Sciences [physics]/Micro and nanotechnologies/Microelectronics ,Field-programmable gate array ,Implementation ,Original Research ,010302 applied physics ,oscillatory neural networks ,Oscillatory neural networks ,Artificial neural network ,Hebbian learning rule ,General Neuroscience ,Oscillatory neural network ,Neuromorphic engineering ,Computer engineering ,FPGA implementation ,Pattern recognition (psychology) ,020201 artificial intelligence & image processing ,Storkey learning rule ,Applications of artificial intelligence ,Unconventional computing ,RC321-571 ,Neuroscience - Abstract
Computing paradigm based on von Neuman architectures cannot keep up with the ever-increasing data growth (also called "data deluge gap"). This has resulted in both the academic and industrial community investigating novel computing paradigms and design approaches at all levels from materials, devices, circuits, architectures, and all the way to system-level implementations and applications. For example, to improve performance, the community has been investigating solutions through massively parallel and distributed systems that are a rupture from von Neumann architectures. As artificial neural networks (ANN) and deep neural networks (DNN) that are trained over hundreds of graphic processing units (GPU)-accelerated servers where each GPU can have thousands of cores. The limitations of data processing through the memory wall in von Neumann architectures have been overcome with bringing computing to the data inspired by biological brainlike computing. An alternative computing approach based on ANNs uses oscillators to compute or oscillatory neural networks (ONNs). Such an approach differs from classical CMOS and classical von Neumann where building blocks are analog and perform computations efficiently. Moreover, data is encoded on the oscillator signals phase, which is a departure from the classical voltage level-based data encoding (such as amplitude voltage to represent a logical bit '1' or '0'). ONNs can perform computations efficiently and can be used to build a more extensive neuromorphic system. How should a designer choose to optimally implement ONNs in analog is the focus of many ongoing research efforts. But here, we address a more fundamental problem, can we efficiently perform AI applications (such as image/pattern recognition) with ONNs? In other words, what are the advantages and limitations of the ONN computing paradigm for practical AI applications? Here, we present a digital ONN implementation to show a proof-of-concept of the ONN approach of "computing-in-phase" for pattern recognition applications. To the best of our knowledge, this is the first attempt to implement an FPGA-based fully-digital ONN. We report ONN accuracy, training, inference, memory capacity, operating frequency, hardware resources based on simulations and implementations of 5x3 and 10x6 ONNs. We present the digital ONN implementation on FPGA for pattern recognition applications such as performing digits recognition from a camera stream. We discuss practical challenges and future directions in implementing digital ONN.
- Published
- 2021
- Full Text
- View/download PDF