Appliance Control by TDoA-based Localization and Gesture Recognition

Ting Hui Chiang; Yan Ann Chen; Chun Ting Chang; Ling Jyh Chen; Yu Chee Tseng

doi:10.1109/PIMRC.2018.8580993

Appliance Control by TDoA-based Localization and Gesture Recognition

Ting Hui Chiang, Yan Ann Chen, Chun Ting Chang, Ling Jyh Chen, Yu Chee Tseng

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

Smart home is one of the major Internet of Things (IoT) applications. When realizing a smart home, designing an intuitive interaction for appliance control has become a crucial issue. A control intention to an appliance comprises two main meanings, identification and control command. But, previous works seldom deliver these two meanings at the same time. To fully convey the control intention, this paper proposes a scheme of intuitive appliance control that tracks and recognizes hand moving trajectory and hand gestures respectively by exploiting acoustic information. We utilize a 3D positioning method based on time difference of arrival (TDoA) of acoustic signals to detect the trajectory of a hand movement for appliance identification and design a gesture recognition method by Doppler effect for control command. We validate the effectiveness of the proposed scheme via real-life experiments. The results show that average locating errors to the targets are 5.24° and 10.35° in the horizontal and vertical planes respectively and the accuracy of gesture recognition is 96.66%. Since human's eyesight is horizontal to the ground, locating an object in the vertical view is error-prone. We also provide a scroll gesture to assist the appliance selection.

Original language	English
Title of host publication	2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781538660096
DOIs	https://doi.org/10.1109/PIMRC.2018.8580993
Publication status	Published - 2018 Dec 18
Externally published	Yes
Event	29th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018 - Bologna, Italy Duration: 2018 Sept 9 → 2018 Sept 12

Publication series

Name	IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC
Volume	2018-September

Other

Other	29th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018
Country/Territory	Italy
City	Bologna
Period	2018/09/09 → 2018/09/12

Keywords

Acoustic signal processing
Doppler effect
Gesture recognition
Indoor localization
Smart home

ASJC Scopus subject areas

Electrical and Electronic Engineering

Access to Document

10.1109/PIMRC.2018.8580993

Cite this

Chiang, T. H., Chen, Y. A., Chang, C. T., Chen, L. J., & Tseng, Y. C. (2018). Appliance Control by TDoA-based Localization and Gesture Recognition. In 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018 Article 8580993 (IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC; Vol. 2018-September). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PIMRC.2018.8580993

Appliance Control by TDoA-based Localization and Gesture Recognition. / Chiang, Ting Hui; Chen, Yan Ann; Chang, Chun Ting et al.
2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018. Institute of Electrical and Electronics Engineers Inc., 2018. 8580993 (IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC; Vol. 2018-September).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Chiang, TH, Chen, YA, Chang, CT, Chen, LJ & Tseng, YC 2018, Appliance Control by TDoA-based Localization and Gesture Recognition. in 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018., 8580993, IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC, vol. 2018-September, Institute of Electrical and Electronics Engineers Inc., 29th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018, Bologna, Italy, 2018/09/09. https://doi.org/10.1109/PIMRC.2018.8580993

Chiang TH, Chen YA, Chang CT, Chen LJ, Tseng YC. Appliance Control by TDoA-based Localization and Gesture Recognition. In 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018. Institute of Electrical and Electronics Engineers Inc. 2018. 8580993. (IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC). doi: 10.1109/PIMRC.2018.8580993

Chiang, Ting Hui ; Chen, Yan Ann ; Chang, Chun Ting et al. / Appliance Control by TDoA-based Localization and Gesture Recognition. 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018. Institute of Electrical and Electronics Engineers Inc., 2018. (IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC).

@inproceedings{558bfd7b5b834934a2d789ba318d882b,

title = "Appliance Control by TDoA-based Localization and Gesture Recognition",

abstract = "Smart home is one of the major Internet of Things (IoT) applications. When realizing a smart home, designing an intuitive interaction for appliance control has become a crucial issue. A control intention to an appliance comprises two main meanings, identification and control command. But, previous works seldom deliver these two meanings at the same time. To fully convey the control intention, this paper proposes a scheme of intuitive appliance control that tracks and recognizes hand moving trajectory and hand gestures respectively by exploiting acoustic information. We utilize a 3D positioning method based on time difference of arrival (TDoA) of acoustic signals to detect the trajectory of a hand movement for appliance identification and design a gesture recognition method by Doppler effect for control command. We validate the effectiveness of the proposed scheme via real-life experiments. The results show that average locating errors to the targets are 5.24° and 10.35° in the horizontal and vertical planes respectively and the accuracy of gesture recognition is 96.66%. Since human's eyesight is horizontal to the ground, locating an object in the vertical view is error-prone. We also provide a scroll gesture to assist the appliance selection.",

keywords = "Acoustic signal processing, Doppler effect, Gesture recognition, Indoor localization, Smart home",

author = "Chiang, {Ting Hui} and Chen, {Yan Ann} and Chang, {Chun Ting} and Chen, {Ling Jyh} and Tseng, {Yu Chee}",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE.; 29th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018 ; Conference date: 09-09-2018 Through 12-09-2018",

year = "2018",

month = dec,

day = "18",

doi = "10.1109/PIMRC.2018.8580993",

language = "English",

series = "IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018",

}

TY - GEN

T1 - Appliance Control by TDoA-based Localization and Gesture Recognition

AU - Chiang, Ting Hui

AU - Chen, Yan Ann

AU - Chang, Chun Ting

AU - Chen, Ling Jyh

AU - Tseng, Yu Chee

PY - 2018/12/18

Y1 - 2018/12/18

N2 - Smart home is one of the major Internet of Things (IoT) applications. When realizing a smart home, designing an intuitive interaction for appliance control has become a crucial issue. A control intention to an appliance comprises two main meanings, identification and control command. But, previous works seldom deliver these two meanings at the same time. To fully convey the control intention, this paper proposes a scheme of intuitive appliance control that tracks and recognizes hand moving trajectory and hand gestures respectively by exploiting acoustic information. We utilize a 3D positioning method based on time difference of arrival (TDoA) of acoustic signals to detect the trajectory of a hand movement for appliance identification and design a gesture recognition method by Doppler effect for control command. We validate the effectiveness of the proposed scheme via real-life experiments. The results show that average locating errors to the targets are 5.24° and 10.35° in the horizontal and vertical planes respectively and the accuracy of gesture recognition is 96.66%. Since human's eyesight is horizontal to the ground, locating an object in the vertical view is error-prone. We also provide a scroll gesture to assist the appliance selection.

AB - Smart home is one of the major Internet of Things (IoT) applications. When realizing a smart home, designing an intuitive interaction for appliance control has become a crucial issue. A control intention to an appliance comprises two main meanings, identification and control command. But, previous works seldom deliver these two meanings at the same time. To fully convey the control intention, this paper proposes a scheme of intuitive appliance control that tracks and recognizes hand moving trajectory and hand gestures respectively by exploiting acoustic information. We utilize a 3D positioning method based on time difference of arrival (TDoA) of acoustic signals to detect the trajectory of a hand movement for appliance identification and design a gesture recognition method by Doppler effect for control command. We validate the effectiveness of the proposed scheme via real-life experiments. The results show that average locating errors to the targets are 5.24° and 10.35° in the horizontal and vertical planes respectively and the accuracy of gesture recognition is 96.66%. Since human's eyesight is horizontal to the ground, locating an object in the vertical view is error-prone. We also provide a scroll gesture to assist the appliance selection.

KW - Acoustic signal processing

KW - Doppler effect

KW - Gesture recognition

KW - Indoor localization

KW - Smart home

UR - http://www.scopus.com/inward/record.url?scp=85060549541&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060549541&partnerID=8YFLogxK

U2 - 10.1109/PIMRC.2018.8580993

DO - 10.1109/PIMRC.2018.8580993

M3 - Conference contribution

AN - SCOPUS:85060549541

T3 - IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC

BT - 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 29th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2018

Y2 - 9 September 2018 through 12 September 2018

ER -

Appliance Control by TDoA-based Localization and Gesture Recognition

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this