Back to Search
Start Over
Deep Reinforcement Learning-Based End-to-End Control for UAV Dynamic Target Tracking
- Source :
- Biomimetics, Vol 7, Iss 4, p 197 (2022)
- Publication Year :
- 2022
- Publisher :
- MDPI AG, 2022.
-
Abstract
- Uncertainty of target motion, limited perception ability of onboard cameras, and constrained control have brought new challenges to unmanned aerial vehicle (UAV) dynamic target tracking control. In virtue of the powerful fitting ability and learning ability of the neural network, this paper proposes a new deep reinforcement learning (DRL)-based end-to-end control method for UAV dynamic target tracking. Firstly, a DRL-based framework using onboard camera image is established, which simplifies the traditional modularization paradigm. Secondly, neural network architecture, reward functions, and soft actor-critic (SAC)-based speed command perception algorithm are designed to train the policy network. The output of the policy network is denormalized and directly used as speed control command, which realizes the UAV dynamic target tracking. Finally, the feasibility of the proposed end-to-end control method is demonstrated by numerical simulation. The results show that the proposed DRL-based framework is feasible to simplify the traditional modularization paradigm. The UAV can track the dynamic target with rapidly changing of speed and direction.
Details
- Language :
- English
- ISSN :
- 23137673
- Volume :
- 7
- Issue :
- 4
- Database :
- Directory of Open Access Journals
- Journal :
- Biomimetics
- Publication Type :
- Academic Journal
- Accession number :
- edsdoj.0085ac9e1d00434fa16bdc77534918e1
- Document Type :
- article
- Full Text :
- https://doi.org/10.3390/biomimetics7040197