An infant emotion recognition system using visual and audio information

Chiung Yao Fang, Chung Wen Ma, Meng Lin Chiang, Sei Wang Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This study presents an infant emotion recognition system using visual and audio information for infants aged 1 to 7 months. The system is divided into two parts, image processing and speech processing. The image processing part detects the infant's face and extracts facial expressions features. In the face detection stage, the system selects the largest skin color region as the facial area, while in the facial expressions feature extraction stage, the system uses the local ternary pattern (LTP) technology to label facial contours and calculates their corresponding Zernike moments. In the speech processing part, the system uses common mel-frequency cepstral coefficients (MFCCs) and its delta cepstrum coefficients as vocalization features. Finally, the system uses support vector machines (SVMs) to classify the facial expressions features and vocalization features, respectively. By combining these types of classification results, the system reaches a decision about the infant's emotion. The average recognition rate of infant emotions is 85.3% in the experiments which, in our view, makes the proposed system robust and efficient.

Original languageEnglish
Title of host publication2017 4th International Conference on Industrial Engineering and Applications, ICIEA 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages284-291
Number of pages8
ISBN (Electronic)9781509067749
DOIs
Publication statusPublished - 2017 Jun 5
Event4th International Conference on Industrial Engineering and Applications, ICIEA 2017 - Nagoya, Japan
Duration: 2017 Apr 212017 Apr 23

Other

Other4th International Conference on Industrial Engineering and Applications, ICIEA 2017
CountryJapan
CityNagoya
Period17/4/2117/4/23

Keywords

  • infant emotion recognition
  • infant monitoring system
  • local ternary pattern (LTP)
  • mel-frequency cepstral coefficients (MFCCs)
  • Zernike moments

ASJC Scopus subject areas

  • Strategy and Management
  • Industrial and Manufacturing Engineering

Fingerprint Dive into the research topics of 'An infant emotion recognition system using visual and audio information'. Together they form a unique fingerprint.

  • Cite this

    Fang, C. Y., Ma, C. W., Chiang, M. L., & Chen, S. W. (2017). An infant emotion recognition system using visual and audio information. In 2017 4th International Conference on Industrial Engineering and Applications, ICIEA 2017 (pp. 284-291). [7939223] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IEA.2017.7939223