TY - GEN
T1 - A Hybrid Attention Mechanism to Improve Tacotron 2 Performance for Indonesian Text-to-Speech Synthesis
AU - Catherina, Angela
AU - Prihasto, Bima
AU - Pratama, Boby Mugi
AU - Kang, Li Wei
AU - Wang, Jia Ching
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - This paper presents a speech synthesis system for the Indonesian language using the Tacotron 2 architecture and HiFi-GAN vocoder. While Tacotron 2 has demonstrated strong performance in high-resource languages, adapting it for Indonesian remains underexplored. To address this, we propose a hybrid attention mechanism that combines location-sensitive and content-based attention to improve alignment accuracy and convergence during training. The system is trained on a custom Indonesian audiobook dataset prepared in LJSpeech format. We compare several model variants, including versions with and without phoneme conversion, and evaluate them using both subjective and objective metrics. Speech quality is assessed through Mean Opinion Score (MOS) ratings, while model performance is evaluated via attention weight visualization. Results show that the proposed hybrid attention mechanism accelerates alignment learning and produces speech with improved naturalness and intelligibility, confirming its effectiveness for low-resource TTS in Indonesian.
AB - This paper presents a speech synthesis system for the Indonesian language using the Tacotron 2 architecture and HiFi-GAN vocoder. While Tacotron 2 has demonstrated strong performance in high-resource languages, adapting it for Indonesian remains underexplored. To address this, we propose a hybrid attention mechanism that combines location-sensitive and content-based attention to improve alignment accuracy and convergence during training. The system is trained on a custom Indonesian audiobook dataset prepared in LJSpeech format. We compare several model variants, including versions with and without phoneme conversion, and evaluate them using both subjective and objective metrics. Speech quality is assessed through Mean Opinion Score (MOS) ratings, while model performance is evaluated via attention weight visualization. Results show that the proposed hybrid attention mechanism accelerates alignment learning and produces speech with improved naturalness and intelligibility, confirming its effectiveness for low-resource TTS in Indonesian.
UR - https://www.scopus.com/pages/publications/105030449373
UR - https://www.scopus.com/pages/publications/105030449373#tab=citedBy
U2 - 10.1109/APSIPAASC65261.2025.11249124
DO - 10.1109/APSIPAASC65261.2025.11249124
M3 - Conference contribution
AN - SCOPUS:105030449373
T3 - 2025 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2025
SP - 579
EP - 582
BT - 2025 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2025
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 17th Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2025
Y2 - 22 October 2025 through 24 October 2025
ER -