Development and Evaluation of Emotional Conversation System Based on Automated Text Generation

Te Lun Yang, Yuen Hsien Tseng

Research output: Contribution to journalArticlepeer-review

Abstract

Based on the corpus provided by the 2019 Chinese Emotional Conversation Generation (CECG) evaluation task, an emotional conversation system is implemented in this paper using deep learning and other technologies such as GPT-2 and BERT. The effectiveness of the system is evaluated based on the test data and criteria provided by CECG. The results based on three human annotators show that the system has a similar effectiveness level with that of the best team participating in the 2019 CECG task. Further case studies reveal that the more post/reply pairs about a topic in the training data, the better the language model of GPT-2 to generate innovative, interesting, and perfect response sentences for that topic. The main contributions of this study are: 1. Integrating emotion into the post string as a condition for computing probability, so as to simply train GPT-2 and make GPT-2 predict in the original way; 2. Applying BERT to predict the coherence of response sentences as a basis for ranking. Although these two techniques are derived from the training mechanisms of GPT and BERT respectively, we have slightly modified them to fit the task of CECG and achieved good results.

Original languageEnglish
Pages (from-to)355-378
Number of pages24
JournalJournal of Educational Media and Library Sciences
Volume57
Issue number3
DOIs
Publication statusPublished - 2020

Keywords

  • Artificial intelligence
  • Conversational system
  • Deep learning
  • Text generation
  • Text understanding

ASJC Scopus subject areas

  • Conservation
  • Information Systems
  • Archaeology
  • Library and Information Sciences

Fingerprint Dive into the research topics of 'Development and Evaluation of Emotional Conversation System Based on Automated Text Generation'. Together they form a unique fingerprint.

Cite this