Research on Digital Twin Simulation Method of Industrial Robot Integrated with Reinforcement Learning

Authors

Tianyue Miao, School of Mechanical Engineering, Anhui University of Technology, Maanshan 243032, China
Lu Wang, School of Mechanical Engineering, Anhui University of Technology, Maanshan 243032, China
Jiaxiao He, School of Mechanical Engineering, Anhui University of Technology, Maanshan 243032, China
Nenggang Xie, School of Mechanical Engineering, Anhui University of Technology, Maanshan 243032, China

Abstract

Abstract: In response to the lack of comprehensive functionality and limited application scenarios in the current field of industrial robot digital twin systems, which results in low versatility, a method for constructing a digital twin system for industrial robots with high versatility is proposed. A four-dimensional system architecture for the digital twin is designed, and the components and functions of the four-dimensional system are analyzed, based on the system level planning of the four-dimensional system, the concept of integrating reinforcement learning into the virtual replacement of real concept is defined. By constructing a multi-attribute virtual model and using TCP communication protocol to build a data communication system for virtual-real data interaction, combined with robot forward and inverse kinematic analysis, the virtual-real mapping and control functions are achieved. A reinforcement learning virtual scene is constructed, using a virtual robot model to replace the physical robot for reinforcement learning training, to achieve automatic path planning functionality. The experimental results verify the feasibility and reliability of the developed digital twin system, providing a new solution for further enriching the functionality of industrial robot digital twin systems.

Recommended Citation

Miao, Tianyue; Wang, Lu; He, Jiaxiao; and Xie, Nenggang (2024) "Research on Digital Twin Simulation Method of Industrial Robot Integrated with Reinforcement Learning," Journal of System Simulation: Vol. 36: Iss. 12, Article 19.
DOI: 10.16182/j.issn1004731x.joss.23-1233
Available at: https://dc-china-simulation.researchcommons.org/journal/vol36/iss12/19

First Page

2971

Last Page

2983

CLC

TP391.9

Recommended Citation

Miao Tianyue, Wang Lu, He Jiaxiao, et al. Research on Digital Twin Simulation Method of Industrial Robot Integrated with Reinforcement Learning[J]. Journal of System Simulation, 2024, 36(12): 2971-2983.

Corresponding Author

Wang Lu

DOI

10.16182/j.issn1004731x.joss.23-1233