GLASS: Investigating Global and Local context Awareness in Speech Separation

  • Kuan Hsun Ho*
  • , En Lun Yu
  • , Jeih Weih Hung
  • , Shih Chieh Huang
  • , Berlin Chen
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Previous speech separation systems commonly employ the Dual-Path (DP) mechanism. The DP mechanism addresses optimization challenges posed by considerable sequential input lengths, yet its compulsory interleaving pattern for local and global feature extraction raises concerns regarding optimal utilization of features across different layers. This study emphasizes the need for parallel processing of global and local information in speech separation, proposing the Global and Local context-Aware Speech Separation method (GLASS). GLASS integrates self-attention and convolutional layers into a parallel design, demonstrating state-of-the-art performance in both anechoic and noisy settings. The findings reveal patterns in the relevance of local and global information across layers, underscoring the significance of proper architecture in improving speech separation systems.

Original languageEnglish
Title of host publicationAPSIPA ASC 2024 - Asia Pacific Signal and Information Processing Association Annual Summit and Conference 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350367331
DOIs
Publication statusPublished - 2024
Event2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2024 - Macau, China
Duration: 2024 Dec 32024 Dec 6

Publication series

NameAPSIPA ASC 2024 - Asia Pacific Signal and Information Processing Association Annual Summit and Conference 2024

Conference

Conference2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2024
Country/TerritoryChina
CityMacau
Period2024/12/032024/12/06

Keywords

  • Global
  • Local Dependencies
  • Speech Separation

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Hardware and Architecture
  • Signal Processing

Fingerprint

Dive into the research topics of 'GLASS: Investigating Global and Local context Awareness in Speech Separation'. Together they form a unique fingerprint.

Cite this