Design of Mirror Therapy System Base on Multi-Channel Surface-Electromyography Signal Pattern Recognition and Mobile Augmented Reality

Numerous studies have proven that the mirror therapy can make rehabilitation more effective on hemiparesis following a stroke. Using surface electromyography (SEMG) to predict gesture presents one of the important subjects in related research areas, including rehabilitation medicine, sports medicine, prosthetic control, and so on. However, current signal analysis methods still fail to achieve accurate recognition of multimode motion in a very reliable way due to the weak physiological signal and low noise–signal ratio. In this paper, a mirror therapy system based on multi-channel SEMG signal pattern recognition and mobile augmented reality is studied. Besides, wavelet transform method is designed to mitigate the noise. The spectrogram obtained by analyzing electromyography signals is proposed to be used as an image. Two approaches, including Convolutional Neural Network (CNN) and grid-optimized Support Vector Machine (SVM), are designed to classify the SEMG of different gestures. The mobile augmented reality provides a virtual hand movement in the real environment to perform mirror therapy process. The experimental results show that the overall accuracy of SVM is 93.07%, and that of CNN is up to 97.8%.