1. Optimization and deployment of CNNs at the edge: the ALOHA experience
- Author
-
Gianfranco Deriu, Andy D. Pimentel, Dolly Sapra, Paola Busia, Battista Biggio, Bernhard Moser, Ilias Theodorakopoulos, Todor Stefanov, Maura Pintor, N. Fragoulis, Natalia Shepeleva, Michael Masin, Francesco Conti, Daniela Loi, Svetlana Minakova, Francesca Palumbo, Paolo Meloni, Luca Benini, Meloni P., Loi D., Busia P., Deriu G., Pimentel A.D., Sapra D., Stefanov T., Minakova S., Conti F., Benini L., Pintor M., Biggio B., Moser B., Shepelev N., Fragoulis N., Theodorakopoulos I., Masin M., Palumbo F., System and Network Engineering (IVI, FNWI), and Computer Systems Architecture (IVI, FNWI)
- Subjects
0209 industrial biotechnology ,business.industry ,Process (engineering) ,Computer science ,Distributed computing ,Deep learning ,02 engineering and technology ,Hardware accelerators ,Porting ,020901 industrial engineering & automation ,Aloha ,Software deployment ,020204 information systems ,Hyperparameter optimization ,0202 electrical engineering, electronic engineering, information engineering ,Convolution Neural Networks ,FPGAs ,Enhanced Data Rates for GSM Evolution ,Artificial intelligence ,Latency (engineering) ,business ,Convolution Neural Network ,FPGA - Abstract
Deep learning (DL) algorithms have already proved their effectiveness on a wide variety of application domains, including speech recognition, natural language processing, and image classification. To foster their pervasive adoption in applications where low latency, privacy issues and data bandwidth are paramount, the current trend is to perform inference tasks at the edge. This requires deployment of DL algorithms on low-energy and resource-constrained computing nodes, often heterogenous and parallel, that are usually more complex to program and to manage without adequate support and experience. In this paper, we present ALOHA, an integrated tool flow that tries to facilitate the design of DL applications and their porting on embedded heterogenous architectures. The proposed tool flow aims at automating different design steps and reducing development costs. ALOHA considers hardware-related variables and security, power efficiency, and adaptivity aspects during the whole development process, from pre-training hyperparameter optimization and algorithm configuration to deployment.
- Published
- 2019