A vision-based human action recognition system for companion robots and human interaction

Meng Lin Chiang, Jian Kai Feng, Wen Lin Zeng, Chiung Yao Fang, Sei Wang Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a vision-based human action recognition system to support human interaction for companion robots. The system is divided into three parts: motion map construction, feature extraction, and human action classification. First, the Kinect 2.0 captures depth images and color images simultaneously using its depth sensor and RGB camera. Second, the information in the depth images and the color images are respectively used to three depth motion maps and a color motion map. These are then combined into one image to calculate the corresponding histogram of oriented gradient (HOG) features. Finally, a support vector machine (SVM) recognizes these HOG features as human actions. The proposed system can recognize eight kinds of human actions, wave left hand, wave right hand, holding left hand, holding right hand, hugging, bowing, walking, and punching. Three databases were used to test the proposed system: Database1 includes videos of adult actions, Database2 includes videos of child actions, and Database3 includes human action videos taken with a moving camera. The recognition accuracy rates of the three tests were 88.7%, 74.37%, and 51.25%, respectively. The experimental results show that the proposed system is efficient and robust.

Original languageEnglish
Title of host publication2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1445-1452
Number of pages8
ISBN (Electronic)9781538683392
DOIs
Publication statusPublished - 2018 Dec
Event4th IEEE International Conference on Computer and Communications, ICCC 2018 - Chengdu, China
Duration: 2018 Dec 72018 Dec 10

Publication series

Name2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018

Conference

Conference4th IEEE International Conference on Computer and Communications, ICCC 2018
CountryChina
CityChengdu
Period18/12/718/12/10

    Fingerprint

Keywords

  • Color motion map
  • Companion robots
  • Depth motiono map
  • Histogram of oriented gradient (HOG)
  • Human action recognition
  • Support vector machine (SVM)

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing

Cite this

Chiang, M. L., Feng, J. K., Zeng, W. L., Fang, C. Y., & Chen, S. W. (2018). A vision-based human action recognition system for companion robots and human interaction. In 2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018 (pp. 1445-1452). [8780777] (2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CompComm.2018.8780777