TY - GEN
T1 - DEVELOPMENT OF AN ENGLISH ORAL ASSESSMENT SYSTEM WITH THE GEPT DATASET
AU - Lu, Hao Chien
AU - Wang, Chung Chun
AU - Lin, Jhen Ke
AU - Chen, Berlin
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - In the rapidly evolving intersection of artificial intelligence and educational technology, multi-perspective assessments are transforming language learning. However, much of the existing research focuses on single-dimensional evaluations, often neglecting the potential of a comprehensive, multi-dimensional oral assessment system that addresses acoustic features, content, and language use simultaneously. Few studies have developed such systems based on established language proficiency tests like the General English Profi-ciency Test (GEPT). This study breaks new ground by creating an integrated, multi-dimensional oral assessment system tailored to the Intermediate level of the GEPT Speaking Test, specifically targeting the Picture Description section. We introduce two novel architectural innovations: the first integrates gram-mar error correction using GECToR and ERRANT into the Language Use Module, while the second enhances the Content Module by combining image and question analy-sis through Blip2 and large language models (LLMs). Our system demonstrates robust performance, achieving 71 % ac-curacy on familiar content and 68% accuracy on unfamiliar content.
AB - In the rapidly evolving intersection of artificial intelligence and educational technology, multi-perspective assessments are transforming language learning. However, much of the existing research focuses on single-dimensional evaluations, often neglecting the potential of a comprehensive, multi-dimensional oral assessment system that addresses acoustic features, content, and language use simultaneously. Few studies have developed such systems based on established language proficiency tests like the General English Profi-ciency Test (GEPT). This study breaks new ground by creating an integrated, multi-dimensional oral assessment system tailored to the Intermediate level of the GEPT Speaking Test, specifically targeting the Picture Description section. We introduce two novel architectural innovations: the first integrates gram-mar error correction using GECToR and ERRANT into the Language Use Module, while the second enhances the Content Module by combining image and question analy-sis through Blip2 and large language models (LLMs). Our system demonstrates robust performance, achieving 71 % ac-curacy on familiar content and 68% accuracy on unfamiliar content.
KW - GEC
KW - LLM
KW - automatic speech assessment
UR - https://www.scopus.com/pages/publications/85215701379
UR - https://www.scopus.com/pages/publications/85215701379#tab=citedBy
U2 - 10.1109/O-COCOSDA64382.2024.10800405
DO - 10.1109/O-COCOSDA64382.2024.10800405
M3 - Conference contribution
AN - SCOPUS:85215701379
T3 - 2024 27th Conference on the Oriental COCOSDA International Committee for the Co-Ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2024 - Proceedings
BT - 2024 27th Conference on the Oriental COCOSDA International Committee for the Co-Ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2024 - Proceedings
A2 - Su, Ming-Hsiang
A2 - Yeh, Jui-Feng
A2 - Liao, Yuan-Fu
A2 - Lee, Chi-Chun
A2 - Taso, Yu
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 27th Conference on the Oriental COCOSDA International Committee for the Co-Ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2024
Y2 - 17 October 2024 through 19 October 2024
ER -