Back to Search Start Over

A deep reinforcement learning-based method applied for solving multi-agent defense and attack problems.

Authors :
Huang, Liwei
Fu, Mingsheng
Qu, Hong
Wang, Siying
Hu, Shangqian
Source :
Expert Systems with Applications. Aug2021, Vol. 176, pN.PAG-N.PAG. 1p.
Publication Year :
2021

Abstract

• The multi-agent defense and attack environment is reconstructed. • Several algorithms are applied to solve the considered problem. • We redefine the state space, the action space and the reward functions accordingly. • Comparison experiments are conducted to show the performance of the employed models. Learning to cooperate among agents has always been an important research topic in artificial intelligence. Multi-agent defense and attack, one of the important issues in multi-agent cooperation, requires multiple agents in the environment to learn effective strategies to achieve their goals. Deep reinforcement learning (DRL) algorithms have natural advantages dealing with continuous control problems especially under situations with dynamic interactions, and have provided new solutions for those long-studied multi-agent cooperation problems. In this paper, we start from deep deterministic policy gradient (DDPG) algorithm and then introduce multi-agent DDPG (MADDPG) to solve the multi-agent defense and attack problem under different situations. We reconstruct the considered environment, redefine the continuous state space, continuous action space, reward functions accordingly, and then apply deep reinforcement learning algorithms to obtain effective decision strategies. Several experiments considering different confrontation scenarios are conducted to validate the feasibility and effectiveness of the DRL-based methods. Experimental results show that through learning the agents can make better decisions, and learning with MADDPG achieves superior performance than learning with other DRL-based models, which also explains the importance and necessity of mastering other agents' information. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09574174
Volume :
176
Database :
Academic Search Index
Journal :
Expert Systems with Applications
Publication Type :
Academic Journal
Accession number :
150127361
Full Text :
https://doi.org/10.1016/j.eswa.2021.114896