Real-time Facial Expression Recognition via Dense & Squeeze-and-Excitation Blocks

Fan Hsun Tseng, Yen Pin Cheng, Yu Wang, Hung Yue Suen*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Due to the coronavirus disease 2019 (COVID-19) pandemic, traditional face-to-face courses have been transformed into online and e-learning courses. Although online courses provide flexible teaching and learning in terms of time and place, teachers cannot be fully aware of their students’ individual learning situation and emotional state. The cognition of learning emotion with facial expression recognition has been a vital issue in recent years. To achieve affective computing, the paper presented a fast recognition model for learning emotions through Dense Squeeze-and-Excitation Networks (DSENet), which rapidly recognizes students’ learning emotions, while the proposed real-time online feedback system notifies teacher instantaneously. Firstly, DSENet is trained and validated by an open dataset called Facial Expression Recognition 2013. Then, we collect students’ learning emotions from e-learning classes and apply transfer learning and data augmentation techniques to improve the testing accuracy.

Original languageEnglish
Article number39
JournalHuman-centric Computing and Information Sciences
Volume12
DOIs
Publication statusPublished - 2022

Keywords

  • Affective computing
  • E-learning
  • Emotion recognition
  • Facial expression recognition
  • Transfer learning

ASJC Scopus subject areas

  • General Computer Science

Fingerprint

Dive into the research topics of 'Real-time Facial Expression Recognition via Dense & Squeeze-and-Excitation Blocks'. Together they form a unique fingerprint.

Cite this