Skip to main navigation Skip to search Skip to main content

一種用於發音評估的 Logit 多面向統計分析法

Translated title of the contribution: A Multi-faceted Statistical Analysis for Logit-based Pronunciation Assessment

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The Goodness of Pronunciation (GOP) score for pronunciation quality assessment is a key technology in computer-assisted language learning. Recent studies have shown that computing GOP scores directly from the acoustic model’s raw output logits outperforms traditional softmax-probability-based methods, because logits avoid probability saturation issues and retain richer discriminative information. However, existing logit-based methods mostly rely on basic statistics such as maxima, means, or variances, which neglect the more complex dynamic distributions and temporal characteristics of logit sequences over phoneme durations. To more comprehensively capture pronunciation details embedded in logit sequences, this study proposes a multi-faceted statistical analysis method. We explore five higher-order statistical indicators that describe different characteristics of logit sequences: (1) moment-generating functions to compute distribution skewness and kurtosis; (2) information theory, using entropy to quantify model uncertainty; (3) Gaussian mixture models (GMMs) to fit multimodal distributions of logits; (4) time-series analysis, computing autocorrelation coefficients to measure logit stability; and (5) extreme value theory, using top-k averaging to obtain more robust peak-confidence estimates. We conduct experiments on the public L2 English speech corpus SpeechOcean762, comparing these newly proposed statistical indicators with baseline methods from the literature (!"#_%&'()*+,, !"#_-&.*+/). Preliminary results show that some higher-order statistical indicators-particularly those that describe logit-sequence stability and distribution shape-achieve higher accuracy on pronunciation-error detection classification tasks and exhibit stronger correlation with human expert ratings. This study demonstrates that deeper statistical modeling of logit sequences is an effective approach to improving the performance of automated pronunciation assessment systems.

Translated title of the contributionA Multi-faceted Statistical Analysis for Logit-based Pronunciation Assessment
Original languageChinese (Traditional)
Title of host publicationROCLING 2025 - 37th Conference on Computational Linguistics and Speech Processing, Proceedings of the Conference
EditorsKai-Wei Chang, Ke-Han Lu, Chih-Kai Yang, Zhi-Rui Tam, Wen-Yu Chang, Chung-Che Wang
PublisherAssociation for Computational Linguistics (ACL)
Pages326-333
Number of pages8
ISBN (Electronic)9798891763791
Publication statusPublished - 2025
Event37th Conference on Computational Linguistics and Speech Processing, ROCLING 2025 - Taipei, Taiwan
Duration: 2025 Nov 20 → 2025 Nov 22

Publication series

NameROCLING 2025 - 37th Conference on Computational Linguistics and Speech Processing, Proceedings of the Conference

Conference

Conference37th Conference on Computational Linguistics and Speech Processing, ROCLING 2025
Country/TerritoryTaiwan
CityTaipei
Period2025/11/20 → 2025/11/22

ASJC Scopus subject areas

  • Speech and Hearing
  • Language and Linguistics

Fingerprint

Dive into the research topics of 'A Multi-faceted Statistical Analysis for Logit-based Pronunciation Assessment'. Together they form a unique fingerprint.

Cite this