Skip to main navigation Skip to search Skip to main content

DeRA-MOS: Optimizing Text-to-Music Evaluation via Decoupled Listwise Ranking and Modality Alignment

  • Chien Chun Wang
  • , Hung Shin Lee*
  • , Hsin Min Wang
  • , Berlin Chen*
  • *Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

Abstract

Evaluating text-to-music (TTM) systems remains expensive because music impression (MI) and text alignment (TA) scores rely on human mean opinion scores (MOS). Most automatic MOS estimators are trained with point-wise regression or distributional classification. These objectives do not directly optimize rank-based metrics and provide weak geometric constraints for cross-modal coherence. To address these gaps, we propose DeRA-MOS, a decoupled optimization framework for TTM evaluation. For MI, we introduce a batch-aware listwise ranking loss that models relative order within each mini-batch and better aligns with evaluation based on Spearman's rank correlation coefficient (SRCC). For TA, we introduce a score-anchored modality alignment loss that maps human scores to target audio-text similarity and regularizes the latent space before fusion. By effectively mitigating the point-wise training mismatch and modality drift, experiments on MusicEval demonstrate that our decoupled framework yields substantial improvements in both MI and TA ranking metrics, establishing a robust paradigm for large-scale TTM evaluation.

Original languageEnglish
Pages (from-to)2440-2444
Number of pages5
JournalIEEE Signal Processing Letters
Volume33
DOIs
Publication statusPublished - 2026

Keywords

  • cross-modal alignment
  • listwise ranking
  • mean opinion score
  • metric learning
  • Text-to-music evaluation

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'DeRA-MOS: Optimizing Text-to-Music Evaluation via Decoupled Listwise Ranking and Modality Alignment'. Together they form a unique fingerprint.

Cite this