Journal of System Simulation
Abstract
Abstract: In order to solve the problem of dynamically addressing firepower intelligent decision-making in anti-UAV cluster combat using a directed energy system, a deep reinforcement learning model is established. Based on the high multi-agent state and action space dimensions of this model, a modeling and simulation method of firepower intelligent decision-making of directed energy system based on joint deep Q network (DQN) is proposed. The state space is constructed from the state of directed energy system, UAV cluster and the directed energy system deployment area. The joint mechanism is used to share the state information of each equipment and the network parameters of the same type of equipment. The threat assessment mechanism is designed to improve generalization, and the action shielding mechanism is established to shield invalid actions. The problems of divergence and slow convergence of multi-agent training, caused by state and action dimension disasters, are effectively solved, and the learning efficiency and generalization of Joint DQN network are improved. According to the simulation results, this method is superior to the traditional rule-based method, which verifies the feasibility and practicability of this method, and provides a new idea for intelligent decision-making of anti-UAV cluster firepower of directed energy system compatible with various deployment schemes.
Recommended Citation
Qu, Changhong; Wang, Junjie; Wang, Kun; Cui, Qingyong; Chen, Jiangyang; and Wang, Xinpeng
(2025)
"A Modeling and Simulation Method for Firepower Intelligent Decision-making of Directed Energy System Basedon Joint DQN,"
Journal of System Simulation: Vol. 37:
Iss.
5, Article 13.
DOI: 10.16182/j.issn1004731x.joss.24-0079
Available at:
https://dc-china-simulation.researchcommons.org/journal/vol37/iss5/13
First Page
1256
Last Page
1265
CLC
TP391.9
Recommended Citation
Qu Changhong, Wang Junjie, Wang Kun, et al. A Modeling and Simulation Method for Firepower Intelligent Decision-making of Directed Energy System Based on Joint DQN[J]. Journal of System Simulation, 2025, 37(5): 1256-1265.
DOI
10.16182/j.issn1004731x.joss.24-0079
Included in
Artificial Intelligence and Robotics Commons, Computer Engineering Commons, Numerical Analysis and Scientific Computing Commons, Operations Research, Systems Engineering and Industrial Engineering Commons, Systems Science Commons