1. Deep-Reinforcement-Learning-Based Latency Minimization in Edge Intelligence Over Vehicular Networks
- Author
-
Hao Wu, Victor C. M. Leung, Lifu Wang, Ning Zhao, F. Richard Yu, and Weiting Zhang
- Subjects
Vehicular ad hoc network ,Artificial neural network ,Computer Networks and Communications ,Computer science ,business.industry ,Distributed computing ,Computer Science Applications ,Hardware and Architecture ,Signal Processing ,Scalability ,Reinforcement learning ,Wireless ,Enhanced Data Rates for GSM Evolution ,Latency (engineering) ,business ,Information Systems ,Communication channel - Abstract
A novel paradigm that combines federated learning with blockchain to empower edge intelligence over vehicular networks (FBVN) can enable latency-sensitive deep neural network-based applications to be executed in a distributed pattern. However, the complex environments in FBVN make the system latency much harder to minimize by traditional methods. In this paper, we model the training and transmission latency of each autonomous vehicle (AV) and consensus latency of the blockchain in-edge side in FBVN. Considering the dynamic and time-varying wireless channel conditions, unpredictable packet error rate, and unstable datasets quality, we adopt duel deep Q-learning (DDQL) as the solving approach. We propose a federated DDQL algorithm, in which the learning agent is deployed on each AV side, and the sensing states on each AV do not need to be shared so that increases scalability and flexibility for practical implementation. Simulation results show that the proposed algorithm has better performance in reducing system latency compared with the other schemes.
- Published
- 2022
- Full Text
- View/download PDF