Artificial Intelligence Can Recognize Whether a Job Applicant Is Selling and/or Lying According to Facial Expressions and Head Movements Much More Correctly Than Human Interviewers

Hung Yue Suen, Kuo En Hung, Che Wei Liu, Yu Sheng Su, Han Chih Fan

研究成果: 雜誌貢獻期刊論文同行評審

摘要

Whether an interviewee&#x2019;s honest and deceptive responses can be detected by the signals of facial expressions in videos has been debated and called to be researched. We developed deep learningmodels enabled by computer vision to extract the temporal patterns of job applicants&#x2019; facial expressions and head movements to identify self-reported honest and deceptive impression management (IM) tactics from video frames in real asynchronous video interviews. A 12- to 15-min video was recorded for each of the <italic>N</italic> = 121 job applicants as they answered five structured behavioral interview questions. Each applicant completed a survey to self-evaluate their trustworthiness on four IM measures. Additionally, a field experiment was conducted to compare the concurrent validity associated with self-reported IMs between our modeling and human interviewers. Human interviewers&#x2019; performance in predicting these IMmeasures from another subset of 30 videos was obtained by having <italic>N</italic> = 30 human interviewers evaluate three recordings. Our models explained 91% and 84% of the variance in honest and deceptive IMs, respectively, and showed a stronger correlation with self-reported IMscores compared to human interviewers.

原文英語
頁(從 - 到)1-12
頁數12
期刊IEEE Transactions on Computational Social Systems
DOIs
出版狀態接受/付印 - 2024

ASJC Scopus subject areas

  • 建模與模擬
  • 社會科學(雜項)
  • 人機介面

指紋

深入研究「Artificial Intelligence Can Recognize Whether a Job Applicant Is Selling and/or Lying According to Facial Expressions and Head Movements Much More Correctly Than Human Interviewers」主題。共同形成了獨特的指紋。

引用此