GestureVLAD: Combining unsupervised features representation and spatio-temporal aggregation for doppler-radar gesture recognition

27Citations
Citations of this article
19Readers
Mendeley users who have this article in their library.

Abstract

In this paper we propose a novel framework to process Doppler-radar signals for hand gesture recognition. Doppler-radar sensors provide many advantages over other emerging sensing modalities, including low development costs and high sensitivity to capture subtle gestures with precision. Furthermore, they have attractive properties for ubiquitous deployment and can be conveniently embedded into different devices. In this scope, current recognition methods still rely in deep CNN-LSTM and 3D CNN-LSTM structures that require sufficient labelled data to optimize millions of parameters and significant amount of computational resources for inference; which limits their deployment. Indeed, subtle gestures recognition is a challenging task due to the high variability of gestures among different subjects. To overcome the challenges in the recognition task and the limitations of the current methods, we propose a shallow learning approach for gesture recognition, that is based on unsupervised range-Doppler features representation, along with a learnable pooling aggregation via NetVLAD. The proposed framework can encode extremely valuable information across time, and results in features that are highly discriminative for hand gesture recognition. Experimentation on publicly available Doppler-radar data shows that the proposed framework outperforms state-of-the-art approaches in terms of recognition accuracy and speed for sequence-level hand gesture classification.

Cite

CITATION STYLE

APA

Berenguer, A. D., Oveneke, M. C., Khalid, H. U. R., Alioscha-Perez, M., Bourdoux, A., & Sahli, H. (2019). GestureVLAD: Combining unsupervised features representation and spatio-temporal aggregation for doppler-radar gesture recognition. IEEE Access, 7, 137122–137135. https://doi.org/10.1109/ACCESS.2019.2942305

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free