Combining Relevance Language Modeling and Clarity Measure for Extractive Speech Summarization

Shih Hung Liu, Kuan Yu Chen, Berlin Chen, Hsin Min Wang, Hsu Chun Yen, Wen Lian Hsu

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

Extractive speech summarization, which purports to select an indicative set of sentences from a spoken document so as to succinctly represent the most important aspects of the document, has garnered much research over the years. In this paper, we cast extractive speech summarization as an ad-hoc information retrieval (IR) problem and investigate various language modeling (LM) methods for important sentence selection. The main contributions of this paper are four-fold. First, we explore a novel sentence modeling paradigm built on top of the notion of relevance, where the relationship between a candidate summary sentence and a spoken document to be summarized is discovered through different granularities of context for relevance modeling. Second, not only lexical but also topical cues inherent in the spoken document are exploited for sentence modeling. Third, we propose a novel clarity measure for use in important sentence selection, which can help quantify the thematic specificity of each individual sentence that is deemed to be a crucial indicator orthogonal to the relevance measure provided by the LM-based methods. Fourth, in an attempt to lessen summarization performance degradation caused by imperfect speech recognition, we investigate making use of different levels of index features for LM-based sentence modeling, including words, subword-level units, and their combination. Experiments on broadcast news summarization seem to demonstrate the performance merits of our methods when compared to several existing well-developed and/or state-of-the-art methods.

Original languageEnglish
Article number7063924
Pages (from-to)957-969
Number of pages13
JournalIEEE Transactions on Audio, Speech and Language Processing
Volume23
Issue number6
DOIs
Publication statusPublished - 2015 Jun 1

Keywords

  • Clarity measure
  • KL divergence
  • language modeling
  • relevance modeling
  • speech summarization

ASJC Scopus subject areas

  • Acoustics and Ultrasonics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Combining Relevance Language Modeling and Clarity Measure for Extractive Speech Summarization'. Together they form a unique fingerprint.

  • Cite this