Human motion tracking using 3d image features with a long short-term memory mechanism model—an example of forward reaching

Kai Yu Chen, Li Wei Chou, Hui Min Lee, Shuenn Tsong Young, Cheng Hung Lin, Yi Shu Zhou, Shih Tsang Tang, Ying Hui Lai*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)


Human motion tracking is widely applied to rehabilitation tasks, and inertial measurement unit (IMU) sensors are a well-known approach for recording motion behavior. IMU sensors can provide accurate information regarding three-dimensional (3D) human motion. However, IMU sensors must be attached to the body, which can be inconvenient or uncomfortable for users. To alleviate this issue, a visual-based tracking system from two-dimensional (2D) RGB images has been studied extensively in recent years and proven to have a suitable performance for human motion tracking. However, the 2D image system has its limitations. Specifically, human motion consists of spatial changes, and the 3D motion features predicted from the 2D images have limitations. In this study, we propose a deep learning (DL) human motion tracking technology using 3D image features with a deep bidirectional long short-term memory (DBLSTM) mechanism model. The experimental results show that, compared with the traditional 2D image system, the proposed system provides improved human motion tracking ability with RMSE in acceleration less than 0.5 (m/s2) X, Y, and Z directions. These findings suggest that the proposed model is a viable approach for future human motion tracking applications.

Original languageEnglish
Article number292
Issue number1
Publication statusPublished - 2022 Jan 1


  • Deep learning
  • Depth image
  • Human motion tracking
  • Rehabilitation application
  • Time-of-flight camera

ASJC Scopus subject areas

  • Analytical Chemistry
  • Information Systems
  • Atomic and Molecular Physics, and Optics
  • Biochemistry
  • Instrumentation
  • Electrical and Electronic Engineering


Dive into the research topics of 'Human motion tracking using 3d image features with a long short-term memory mechanism model—an example of forward reaching'. Together they form a unique fingerprint.

Cite this