Sensor-Based Continuous Hand Gesture Recognition by Long Short-Term Memory

Tsung Ming Tai, Yun Jie Jhang, Zhen Wei Liao, Kai Chung Teng, Wen Jyi Hwang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

27 Citations (Scopus)


This article aims to present a novel sensor-based continuous hand gesture recognition algorithm by long short-term memory (LSTM). Only the basic accelerators and/or gyroscopes are required by the algorithm. Given a sequence of input sensory data, a many-to-many LSTM scheme is adopted to produce an output path. A maximum a posteriori estimation is then carried out based on the observed path to obtain the final classification results. A prototype system based on smartphones has been implemented for the performance evaluation. Experimental results show that the proposed algorithm is an effective alternative for robust and accurate hand-gesture recognition.

Original languageEnglish
Article number6000704
JournalIEEE Sensors Letters
Issue number3
Publication statusPublished - 2018 Sept


  • Sensor applications
  • continuous hand gesture recognition
  • human machine interface
  • long short-term memory (LSTM)

ASJC Scopus subject areas

  • Instrumentation
  • Electrical and Electronic Engineering


Dive into the research topics of 'Sensor-Based Continuous Hand Gesture Recognition by Long Short-Term Memory'. Together they form a unique fingerprint.

Cite this