Appliance Control by TDoA-based Localization and Gesture Recognition

Ting Hui Chiang, Yan Ann Chen, Chun Ting Chang, Ling Jyh Chen, Yu Chee Tseng

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Smart home is one of the major Internet of Things (IoT) applications. When realizing a smart home, designing an intuitive interaction for appliance control has become a crucial issue. A control intention to an appliance comprises two main meanings, identification and control command. But, previous works seldom deliver these two meanings at the same time. To fully convey the control intention, this paper proposes a scheme of intuitive appliance control that tracks and recognizes hand moving trajectory and hand gestures respectively by exploiting acoustic information. We utilize a 3D positioning method based on time difference of arrival (TDoA) of acoustic signals to detect the trajectory of a hand movement for appliance identification and design a gesture recognition method by Doppler effect for control command. We validate the effectiveness of the proposed scheme via real-life experiments. The results show that average locating errors to the targets are 5.24° and 10.35° in the horizontal and vertical planes respectively and the accuracy of gesture recognition is 96.66%. Since human's eyesight is horizontal to the ground, locating an object in the vertical view is error-prone. We also provide a scroll gesture to assist the appliance selection.

Original languageEnglish
Title of host publication2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538660096
DOIs
Publication statusPublished - 2018 Dec 18
Event29th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018 - Bologna, Italy
Duration: 2018 Sep 92018 Sep 12

Publication series

NameIEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC
Volume2018-September

Other

Other29th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018
CountryItaly
CityBologna
Period18/9/918/9/12

Keywords

  • Acoustic signal processing
  • Doppler effect
  • Gesture recognition
  • Indoor localization
  • Smart home

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Appliance Control by TDoA-based Localization and Gesture Recognition'. Together they form a unique fingerprint.

  • Cite this

    Chiang, T. H., Chen, Y. A., Chang, C. T., Chen, L. J., & Tseng, Y. C. (2018). Appliance Control by TDoA-based Localization and Gesture Recognition. In 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018 [8580993] (IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC; Vol. 2018-September). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PIMRC.2018.8580993