An infant emotion recognition system using visual and audio information

Chiung Yao Fang, Chung Wen Ma, Meng Lin Chiang, Sei Wang Chen

研究成果: 書貢獻/報告類型會議論文篇章

3 引文 斯高帕斯(Scopus)

摘要

This study presents an infant emotion recognition system using visual and audio information for infants aged 1 to 7 months. The system is divided into two parts, image processing and speech processing. The image processing part detects the infant's face and extracts facial expressions features. In the face detection stage, the system selects the largest skin color region as the facial area, while in the facial expressions feature extraction stage, the system uses the local ternary pattern (LTP) technology to label facial contours and calculates their corresponding Zernike moments. In the speech processing part, the system uses common mel-frequency cepstral coefficients (MFCCs) and its delta cepstrum coefficients as vocalization features. Finally, the system uses support vector machines (SVMs) to classify the facial expressions features and vocalization features, respectively. By combining these types of classification results, the system reaches a decision about the infant's emotion. The average recognition rate of infant emotions is 85.3% in the experiments which, in our view, makes the proposed system robust and efficient.

原文英語
主出版物標題2017 4th International Conference on Industrial Engineering and Applications, ICIEA 2017
發行者Institute of Electrical and Electronics Engineers Inc.
頁面284-291
頁數8
ISBN(電子)9781509067749
DOIs
出版狀態已發佈 - 2017 六月 5
事件4th International Conference on Industrial Engineering and Applications, ICIEA 2017 - Nagoya, 日本
持續時間: 2017 四月 212017 四月 23

出版系列

名字2017 4th International Conference on Industrial Engineering and Applications, ICIEA 2017

其他

其他4th International Conference on Industrial Engineering and Applications, ICIEA 2017
國家日本
城市Nagoya
期間2017/04/212017/04/23

ASJC Scopus subject areas

  • Strategy and Management
  • Industrial and Manufacturing Engineering

指紋 深入研究「An infant emotion recognition system using visual and audio information」主題。共同形成了獨特的指紋。

引用此