Rehabilitation Training System of VR-based Speech Apraxia

Authors

Huanhuan Jiao, 1. School of Information Science and Engineering, Hangzhou Normal University, Hangzhou 311121, China; ;3. Virtual Reality and Intelligent Systems Research, Hangzhou Normal University, Hangzhou 311121, China; ;
Zhigeng Pan, 2.Alibaba Business School, Hangzhou Normal University, Hangzhou 311121, China; ;3. Virtual Reality and Intelligent Systems Research, Hangzhou Normal University, Hangzhou 311121, China; ;4. Guangzhou nine Digital Technology Co., Ltd., Guangzhou 510000, China;
Shuchang Xu, 1. School of Information Science and Engineering, Hangzhou Normal University, Hangzhou 311121, China; ;
Qingshu Yuan, 1. School of Information Science and Engineering, Hangzhou Normal University, Hangzhou 311121, China; ;

Abstract

Abstract: Aiming at the problem that the enthusiasm of active training in patients with traditional speech apraxia rehabilitation is gradually weakened, a virtual reality-based rehabilitation training system for speech apraxia is designed. The system simulates the 26 monosyllabic pronunciation mouths shapes made by virtual human in Chinese and uses it for the learning module. It is proposed to identify 26 monosyllabic words by using the isolated word speech recognition algorithm, which improves the accuracy of speech recognition. The system includes a training module and a scene module for assisting the patient's pronunciation rehabilitation training. The evaluation results show that the virtual human articulation process in the system can realistically simulate the movement of real articulation organs, which plays a positive role in improving the patients' language ability.

Recommended Citation

Jiao, Huanhuan; Pan, Zhigeng; Xu, Shuchang; and Yuan, Qingshu (2019) "Rehabilitation Training System of VR-based Speech Apraxia," Journal of System Simulation: Vol. 31: Iss. 11, Article 17.
DOI: 10.16182/j.issn1004731x.joss.19-FZ0334
Available at: https://dc-china-simulation.researchcommons.org/journal/vol31/iss11/17

First Page

2344

Revised Date

2019-07-16

DOI Link

https://doi.org/10.16182/j.issn1004731x.joss.19-FZ0334

Last Page

2349

CLC

TP391.9

Recommended Citation

Jiao Huanhuan, Pan Zhigeng, Xu Shuchang, Yuan Qingshu. Rehabilitation Training System of VR-based Speech Apraxia[J]. Journal of System Simulation, 2019, 31(11): 2344-2349.

DOI

10.16182/j.issn1004731x.joss.19-FZ0334