Combining Relevance Language Modeling and Clarity Measure for Extractive Speech Summarization

Shih Hung Liu, Kuan Yu Chen, Berlin Chen*, Hsin Min Wang, Hsu Chun Yen, Wen Lian Hsu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

28 Citations (Scopus)


Extractive speech summarization, which purports to select an indicative set of sentences from a spoken document so as to succinctly represent the most important aspects of the document, has garnered much research over the years. In this paper, we cast extractive speech summarization as an ad-hoc information retrieval (IR) problem and investigate various language modeling (LM) methods for important sentence selection. The main contributions of this paper are four-fold. First, we explore a novel sentence modeling paradigm built on top of the notion of relevance, where the relationship between a candidate summary sentence and a spoken document to be summarized is discovered through different granularities of context for relevance modeling. Second, not only lexical but also topical cues inherent in the spoken document are exploited for sentence modeling. Third, we propose a novel clarity measure for use in important sentence selection, which can help quantify the thematic specificity of each individual sentence that is deemed to be a crucial indicator orthogonal to the relevance measure provided by the LM-based methods. Fourth, in an attempt to lessen summarization performance degradation caused by imperfect speech recognition, we investigate making use of different levels of index features for LM-based sentence modeling, including words, subword-level units, and their combination. Experiments on broadcast news summarization seem to demonstrate the performance merits of our methods when compared to several existing well-developed and/or state-of-the-art methods.

Original languageEnglish
Article number7063924
Pages (from-to)957-969
Number of pages13
JournalIEEE Transactions on Audio, Speech and Language Processing
Issue number6
Publication statusPublished - 2015 Jun 1
Externally publishedYes


  • Clarity measure
  • KL divergence
  • language modeling
  • relevance modeling
  • speech summarization

ASJC Scopus subject areas

  • Acoustics and Ultrasonics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Combining Relevance Language Modeling and Clarity Measure for Extractive Speech Summarization'. Together they form a unique fingerprint.

Cite this