Research on sEMG-Based Gesture Recognition by Dual-View Deep Learning

Abstract

In the field of human-machine interaction, gesture recognition using sparse multichannel surface electromyography (sEMG) remains a challenge. Based on the Hilbert filling curve, a dual-view multi-scale convolutional neural network (DVMSCNN) is designed to enhance gesture recognition performance in this paper. The network consists of two parts. In the first part, sEMG is filled using Hilbert filling curve, and the obtained images in the time and electrode domain are used as inputs to the block. In the second part, the depth features learned by block are fused and classified by a 'layer fusion' based view aggregation network. The evaluation of the architecture in the four databases of Ninapro-DB1, DB2, DB3 and DB4 shows that DVMSCNN is more than 7% more accurate than other state-of-the-art methods. When validated using a home-grown dataset, DVMSCNN was able to achieve a recognition rate of 0.8848.