跳至主導覽 跳至搜尋 跳過主要內容

DEVELOPMENT OF AN ENGLISH ORAL ASSESSMENT SYSTEM WITH THE GEPT DATASET

  • Hao Chien Lu
  • , Chung Chun Wang
  • , Jhen Ke Lin
  • , Berlin Chen

研究成果: 書貢獻/報告類型會議論文篇章

摘要

In the rapidly evolving intersection of artificial intelligence and educational technology, multi-perspective assessments are transforming language learning. However, much of the existing research focuses on single-dimensional evaluations, often neglecting the potential of a comprehensive, multi-dimensional oral assessment system that addresses acoustic features, content, and language use simultaneously. Few studies have developed such systems based on established language proficiency tests like the General English Profi-ciency Test (GEPT). This study breaks new ground by creating an integrated, multi-dimensional oral assessment system tailored to the Intermediate level of the GEPT Speaking Test, specifically targeting the Picture Description section. We introduce two novel architectural innovations: the first integrates gram-mar error correction using GECToR and ERRANT into the Language Use Module, while the second enhances the Content Module by combining image and question analy-sis through Blip2 and large language models (LLMs). Our system demonstrates robust performance, achieving 71 % ac-curacy on familiar content and 68% accuracy on unfamiliar content.

原文英語
主出版物標題2024 27th Conference on the Oriental COCOSDA International Committee for the Co-Ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2024 - Proceedings
編輯Ming-Hsiang Su, Jui-Feng Yeh, Yuan-Fu Liao, Chi-Chun Lee, Yu Taso
發行者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子)9798331506032
DOIs
出版狀態已發佈 - 2024
事件27th Conference on the Oriental COCOSDA International Committee for the Co-Ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2024 - Hsinchu, 臺灣
持續時間: 2024 10月 172024 10月 19

出版系列

名字2024 27th Conference on the Oriental COCOSDA International Committee for the Co-Ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2024 - Proceedings

會議

會議27th Conference on the Oriental COCOSDA International Committee for the Co-Ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2024
國家/地區臺灣
城市Hsinchu
期間2024/10/172024/10/19

ASJC Scopus subject areas

  • 電腦視覺和模式識別
  • 人機介面
  • 資訊系統
  • 資訊系統與管理
  • 安全、風險、可靠性和品質
  • 圖書館與資訊科學
  • 語言與語言學

指紋

深入研究「DEVELOPMENT OF AN ENGLISH ORAL ASSESSMENT SYSTEM WITH THE GEPT DATASET」主題。共同形成了獨特的指紋。

引用此