Hand gesture recognition based on range Doppler-angle trajectory and LSTM network using an MIMO radar

Xinbo Zheng; Zhaocheng Yang; Kaixuan He; Haifan Liu

doi:10.1117/12.2558317

31 December 2019 Hand gesture recognition based on range Doppler-angle trajectory and LSTM network using an MIMO radar

Xinbo Zheng, Zhaocheng Yang, Kaixuan He, Haifan Liu

Proceedings Volume 11384, Eleventh International Conference on Signal Processing Systems; 113840P (2019) https://doi.org/10.1117/12.2558317
Event: Eleventh International Conference on Signal Processing Systems, 2019, Chengdu, China

Abstract

Touchless hand gesture recognition is of great importance for human-computer interaction (HCI). In this paper, we present a hand gesture recognition approach based on range-Doppler-angle trajectory and the long short-term memory (LSTM) network with a 77GHz frequency modulated continuous wave (FMCW) multiple-input-multiple-output (MIMO) radar. Firstly, the hand gesture fast-time-slow-time-antenna 3 dimension (3D) data are collected by the FMCW MIMO radar. Additionally, by performing the discretize Fourier transform (DFT) to the fast-time and slow-time, respectively, we obtain the range-profile and Doppler-profile. Then, by using the multiple signal classification (MUSIC) approach, we estimate the angle-profile of the hand gestures. To smooth and eliminate the noise effects, we apply the Kalman filtering to the estimated range-profile, Doppler-profile and angle-profile, respectively, and obtain the range-Doppler-angle trajectory signature. After that, by exploiting the temporal and spatial correlations, we construct a LSTM network for the hand gesture recognition. Experiments with 6 hand gestures are conducted and show that the proposed approach can recognize 6 hand gestures with an average accuracy over 97%.

Citation Download Citation

Xinbo Zheng, Zhaocheng Yang, Kaixuan He, and Haifan Liu "Hand gesture recognition based on range Doppler-angle trajectory and LSTM network using an MIMO radar", Proc. SPIE 11384, Eleventh International Conference on Signal Processing Systems, 113840P (31 December 2019); https://doi.org/10.1117/12.2558317

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available