Journal of System Simulation
Abstract
Abstract: To overcome the practical shortcomings in the driving command training of special vehicles, a simulation training technology framework based on gesture behavior cognition and command interaction was proposed. A somatosensory interactive motion capture device and human skeleton model were used to conduct the real-time dynamic recognition and spatial coordinate transformation of the gesture actions of the command training personnel. The median filtering method was applied to eliminate the abrupt data and random noise. The spatial coordinates were processed consistently by using the human skeleton centralization and normalization method. Based on the command gesture action behavior model library and the spatial posture angle calculation of arm skeletons, the posture features of different command gesture actions were determined, and the gesture behavior cognition based on action features was realized. The intelligent vehicle motion command information and control parameters were formed through the association and mapping of gesture commands and sent to the motion control module through the wireless communication protocol. After parsing and processing, they were converted into voltage and current signals to drive the intelligent vehicle to move forward/backward and turn left/right, ultimately achieving real-time interactive control of its motion process by different command gestures. Test verification by multiple groups of command training personnel shows that the proposed technical means and method approaches have good versatility, consistency, and accuracy, which can provide an economical and efficient solution for the driving command training of special vehicles.
Recommended Citation
Li, Xiangyang; Zhang, Zhili; Wang, Rui; Wang, Xiao; and Chi, Cheng
(2025)
"Research on Simulation Training Technology for Special Vehicle Command Based on Gesture Behavior Cognition Interaction,"
Journal of System Simulation: Vol. 37:
Iss.
7, Article 13.
DOI: 10.16182/j.issn1004731x.joss.25-0600
Available at:
https://dc-china-simulation.researchcommons.org/journal/vol37/iss7/13
First Page
1804
Last Page
1822
CLC
TP391.9
Recommended Citation
Li Xiangyang, Zhang Zhili, Wang Rui, et al. Research on Simulation Training Technology for Special Vehicle Command Based on Gesture Behavior Cognition Interaction[J]. Journal of System Simulation, 2025, 37(7): 1804-1822.
DOI
10.16182/j.issn1004731x.joss.25-0600
Included in
Artificial Intelligence and Robotics Commons, Computer Engineering Commons, Numerical Analysis and Scientific Computing Commons, Operations Research, Systems Engineering and Industrial Engineering Commons, Systems Science Commons