Predicting behavioral competencies automatically from facial expressions in real-time video-recorded interviews

Yu Sheng Su, Hung Yue Suen*, Kuo En Hung

*此作品的通信作者

研究成果: 雜誌貢獻期刊論文同行評審

11 引文 斯高帕斯(Scopus)

摘要

This work aims to develop a real-time image and video processor enabled with an artificial intelligence (AI) agent that can predict a job candidate’s behavioral competencies according to his or her facial expressions. This is accomplished using a real-time video-recorded interview with a histogram of oriented gradients and support vector machine (HOG-SVM) plus convolutional neural network (CNN) recognition. Different from the classical view of recognizing emotional states, this prototype system was developed to automatically decode a job candidate’s behaviors by their microexpressions based on the behavioral ecology view of facial displays (BECV) in the context of employment interviews using a real-time video-recorded interview. An experiment was conducted at a Fortune 500 company, and the video records and competency scores were collected from the company’s employees and hiring managers. The results indicated that our proposed system can provide better predictive power than can human-structured interviews, personality inventories, occupation interest testing, and assessment centers. As such, our proposed approach can be utilized as an effective screening method using a personal-value-based competency model.

原文英語
頁(從 - 到)1011-1021
頁數11
期刊Journal of Real-Time Image Processing
18
發行號4
DOIs
出版狀態已發佈 - 2021 八月

ASJC Scopus subject areas

  • 資訊系統

指紋

深入研究「Predicting behavioral competencies automatically from facial expressions in real-time video-recorded interviews」主題。共同形成了獨特的指紋。

引用此