Robust speech recognition via enhancing the complex-valued acoustic spectrum in modulation domain

Jeih Weih Hung, Hsin Ju Hsieh, Berlin Chen

Research output: Contribution to journalArticlepeer-review

14 Citations (Scopus)


The purpose of this paper is to develop a novel speech feature extraction framework for independently compensating the real and imaginary acoustic spectra of speech signals in the modulation domain with the techniques of histogram equalization (HEQ) and non-negative matrix factorization (NMF). By doing so, we can enhance not only the magnitude but also the phase components of the acoustic spectra, thereby creating noise-robust speech features. More specifically, the proposed framework makes the following three major contributions: First, via either of the HEQ and NMF operations, the long-term cross-frame correlation among the acoustic spectra at the same frequency can be captured to compensate for the spectral distortion caused by noise. Second, the noise effect can be handled in a high acoustic frequency resolution. Finally, the distortion dwelt in the acoustic spectra can be more extensively mitigated due to the independent processes for the respective real and imaginary parts. The evaluation experiments were carried out on the Aurora-2 and Aurora-4 benchmark tasks, and the corresponding results suggest that our proposed methods can achieve performance competitive to or better than many widely used noise robustness methods, including the well-known advanced front-end (AFE) extraction scheme, in speech recognition.

Original languageEnglish
Pages (from-to)236-251
Number of pages16
JournalIEEE/ACM Transactions on Audio Speech and Language Processing
Issue number2
Publication statusPublished - 2016 Feb


  • Automatic speech recognition (ASR)
  • Feature extraction
  • Histogram equalization (HEQ)
  • Modulation spectrum
  • Noise robustness
  • Non-negative matrix factorization (NMF)

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Acoustics and Ultrasonics
  • Computational Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Robust speech recognition via enhancing the complex-valued acoustic spectrum in modulation domain'. Together they form a unique fingerprint.

Cite this