Recognition of hand gesture sequences by accelerometers and gyroscopes

Yen Cheng Chu, Yun Jie Jhang, Tsung Ming Tai, Wen Jyi Hwang*

*此作品的通信作者

研究成果: 雜誌貢獻期刊論文同行評審

1 引文 斯高帕斯(Scopus)

摘要

The objective of this study is to present novel neural network (NN) algorithms and systems for sensor-based hand gesture recognition. The algorithms are able to classify accurately a sequence of hand gestures from the sensory data produced by accelerometers and gyroscopes. They are the extensions from the PairNet, which is a Convolutional Neural Network (CNN) capable of carrying out simple pairing operations with low computational complexities. Three different types of feedforward NNs, termed Residual PairNet, PairNet with Inception, and Residual PairNet with Inception are proposed for the extension. They are the PairNet operating in conjunction with short-cut connections and/or inception modules for achieving high classification accuracy and low computation complexity. A prototype system based on smart phones for remote control of home appliances has been implemented for the performance evaluation. Experimental results reveal that the PairNet has superior classification accuracy over its basic CNN and Recurrent NN (RNN) counterparts. Furthermore, the Residual PairNet, PairNet with Inception, and Residual PairNet with Inception are able to further improve classification hit rate and/or reduce recognition time for hand gesture recognition.

原文英語
文章編號6507
期刊Applied Sciences (Switzerland)
10
發行號18
DOIs
出版狀態已發佈 - 2020 九月
對外發佈

ASJC Scopus subject areas

  • 材料科學(全部)
  • 儀器
  • 工程 (全部)
  • 製程化學與技術
  • 電腦科學應用
  • 流體流動和轉移過程

指紋

深入研究「Recognition of hand gesture sequences by accelerometers and gyroscopes」主題。共同形成了獨特的指紋。

引用此