TY - GEN
T1 - 一種用於發音評估的 Logit 多面向統計分析法
AU - Liao, Chieh Ren
AU - Chen, Berlin
N1 - Publisher Copyright:
© 2025 Association for Computational Linguistics.
PY - 2025
Y1 - 2025
N2 - The Goodness of Pronunciation (GOP) score for pronunciation quality assessment is a key technology in computer-assisted language learning. Recent studies have shown that computing GOP scores directly from the acoustic model’s raw output logits outperforms traditional softmax-probability-based methods, because logits avoid probability saturation issues and retain richer discriminative information. However, existing logit-based methods mostly rely on basic statistics such as maxima, means, or variances, which neglect the more complex dynamic distributions and temporal characteristics of logit sequences over phoneme durations. To more comprehensively capture pronunciation details embedded in logit sequences, this study proposes a multi-faceted statistical analysis method. We explore five higher-order statistical indicators that describe different characteristics of logit sequences: (1) moment-generating functions to compute distribution skewness and kurtosis; (2) information theory, using entropy to quantify model uncertainty; (3) Gaussian mixture models (GMMs) to fit multimodal distributions of logits; (4) time-series analysis, computing autocorrelation coefficients to measure logit stability; and (5) extreme value theory, using top-k averaging to obtain more robust peak-confidence estimates. We conduct experiments on the public L2 English speech corpus SpeechOcean762, comparing these newly proposed statistical indicators with baseline methods from the literature (!"#_%&'()*+,, !"#_-&.*+/). Preliminary results show that some higher-order statistical indicators-particularly those that describe logit-sequence stability and distribution shape-achieve higher accuracy on pronunciation-error detection classification tasks and exhibit stronger correlation with human expert ratings. This study demonstrates that deeper statistical modeling of logit sequences is an effective approach to improving the performance of automated pronunciation assessment systems.
AB - The Goodness of Pronunciation (GOP) score for pronunciation quality assessment is a key technology in computer-assisted language learning. Recent studies have shown that computing GOP scores directly from the acoustic model’s raw output logits outperforms traditional softmax-probability-based methods, because logits avoid probability saturation issues and retain richer discriminative information. However, existing logit-based methods mostly rely on basic statistics such as maxima, means, or variances, which neglect the more complex dynamic distributions and temporal characteristics of logit sequences over phoneme durations. To more comprehensively capture pronunciation details embedded in logit sequences, this study proposes a multi-faceted statistical analysis method. We explore five higher-order statistical indicators that describe different characteristics of logit sequences: (1) moment-generating functions to compute distribution skewness and kurtosis; (2) information theory, using entropy to quantify model uncertainty; (3) Gaussian mixture models (GMMs) to fit multimodal distributions of logits; (4) time-series analysis, computing autocorrelation coefficients to measure logit stability; and (5) extreme value theory, using top-k averaging to obtain more robust peak-confidence estimates. We conduct experiments on the public L2 English speech corpus SpeechOcean762, comparing these newly proposed statistical indicators with baseline methods from the literature (!"#_%&'()*+,, !"#_-&.*+/). Preliminary results show that some higher-order statistical indicators-particularly those that describe logit-sequence stability and distribution shape-achieve higher accuracy on pronunciation-error detection classification tasks and exhibit stronger correlation with human expert ratings. This study demonstrates that deeper statistical modeling of logit sequences is an effective approach to improving the performance of automated pronunciation assessment systems.
UR - https://www.scopus.com/pages/publications/105039842354
UR - https://www.scopus.com/pages/publications/105039842354#tab=citedBy
M3 - 會議論文篇章
AN - SCOPUS:105039842354
T3 - ROCLING 2025 - 37th Conference on Computational Linguistics and Speech Processing, Proceedings of the Conference
SP - 326
EP - 333
BT - ROCLING 2025 - 37th Conference on Computational Linguistics and Speech Processing, Proceedings of the Conference
A2 - Chang, Kai-Wei
A2 - Lu, Ke-Han
A2 - Yang, Chih-Kai
A2 - Tam, Zhi-Rui
A2 - Chang, Wen-Yu
A2 - Wang, Chung-Che
PB - Association for Computational Linguistics (ACL)
T2 - 37th Conference on Computational Linguistics and Speech Processing, ROCLING 2025
Y2 - 20 November 2025 through 22 November 2025
ER -