An semg-controlled 3d game for rehabilitation therapies: Real-time time hand gesture recognition using deep learning techniques

62Citations
Citations of this article
102Readers
Mendeley users who have this article in their library.

Abstract

In recent years the advances in Artificial Intelligence (AI) have been seen to play an important role in human well-being, in particular enabling novel forms of human-computer interaction for people with a disability. In this paper, we propose a sEMG-controlled 3D game that leverages a deep learning-based architecture for real-time gesture recognition. The 3D game experience developed in the study is focused on rehabilitation exercises, allowing individuals with certain disabilities to use low-cost sEMG sensors to control the game experience. For this purpose, we acquired a novel dataset of seven gestures using the Myo armband device, which we utilized to train the proposed deep learning model. The signals captured were used as an input of a Conv-GRU architecture to classify the gestures. Further, we ran a live system with the participation of different individuals and analyzed the neural network’s classification for hand gestures. Finally, we also evaluated our system, testing it for 20 rounds with new participants and analyzed its results in a user study.

References Powered by Scopus

Learning phrase representations using RNN encoder-decoder for statistical machine translation

11620Citations
N/AReaders
Get full text

A review of wearable sensors and systems with application in rehabilitation

1720Citations
N/AReaders
Get full text

Myoelectric control systems-A survey

1077Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Wearable-sensors-based platform for gesture recognition of autism spectrum disorder children using machine learning algorithms

36Citations
N/AReaders
Get full text

Virtual/Augmented Reality for Rehabilitation Applications Using Electromyography as Control/Biofeedback: Systematic Literature Review

35Citations
N/AReaders
Get full text

Multi-Category Gesture Recognition Modeling Based on sEMG and IMU Signals

34Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Nasri, N., Orts-Escolano, S., & Cazorla, M. (2020, November 2). An semg-controlled 3d game for rehabilitation therapies: Real-time time hand gesture recognition using deep learning techniques. Sensors (Switzerland). MDPI AG. https://doi.org/10.3390/s20226451

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 22

63%

Professor / Associate Prof. 5

14%

Lecturer / Post doc 4

11%

Researcher 4

11%

Readers' Discipline

Tooltip

Engineering 12

38%

Computer Science 11

34%

Medicine and Dentistry 6

19%

Business, Management and Accounting 3

9%

Article Metrics

Tooltip
Mentions
Blog Mentions: 1

Save time finding and organizing research with Mendeley

Sign up for free