Improving the Intelligibility of Speech for Simulated Electric and Acoustic Stimulation Using Fully Convolutional Neural Networks

Natalie Yu Hsien Wang, Hsiao Lan Sharon Wang, Tao Wei Wang, Szu Wei Fu, Xugan Lu, Hsin Min Wang, Yu Tsao

研究成果: 雜誌貢獻期刊論文同行評審

摘要

Combined electric and acoustic stimulation (EAS) has demonstrated better speech recognition than conventional cochlear implant (CI) and yielded satisfactory performance under quiet conditions. However, when noise signals are involved, both the electric signal and the acoustic signal may be distorted, thereby resulting in poor recognition performance. To suppress noise effects, speech enhancement (SE) is a necessary unit in EAS devices. Recently, a time-domain speech enhancement algorithm based on the fully convolutional neural networks (FCN) with a short-Time objective intelligibility (STOI)-based objective function (termed FCN(S) in short) has received increasing attention due to its simple structure and effectiveness of restoring clean speech signals from noisy counterparts. With evidence showing the benefits of FCN(S) for normal speech, this study sets out to assess its ability to improve the intelligibility of EAS simulated speech. Objective evaluations and listening tests were conducted to examine the performance of FCN(S) in improving the speech intelligibility of normal and vocoded speech in noisy environments. The experimental results show that, compared with the traditional minimum-mean square-error SE method and the deep denoising autoencoder SE method, FCN(S) can obtain better gain in the speech intelligibility for normal as well as vocoded speech. This study, being the first to evaluate deep learning SE approaches for EAS, confirms that FCN(S) is an effective SE approach that may potentially be integrated into an EAS processor to benefit users in noisy environments.

原文英語
文章編號9281097
頁(從 - 到)184-195
頁數12
期刊IEEE Transactions on Neural Systems and Rehabilitation Engineering
29
DOIs
出版狀態已發佈 - 2021

ASJC Scopus subject areas

  • Internal Medicine
  • Neuroscience(all)
  • Biomedical Engineering

指紋 深入研究「Improving the Intelligibility of Speech for Simulated Electric and Acoustic Stimulation Using Fully Convolutional Neural Networks」主題。共同形成了獨特的指紋。

引用此