Extractive broadcast news summarization leveraging recurrent neural network language modeling techniques

Kuan Yu Chen, Shih Hung Liu, Berlin Chen, Hsin Min Wang, Ea Ee Jan, Wen Lian Hsu, Hsin Hsi Chen

Research output: Contribution to journalArticlepeer-review

20 Citations (Scopus)

Abstract

Extractive text or speech summarization manages to select a set of salient sentences from an original document and concatenate them to form a summary, enabling users to better browse through and understand the content of the document. A recent stream of research on extractive summarization is to employ the language modeling (LM) approach for important sentence selection, which has proven to be effective for performing speech summarization in an unsupervised fashion. However, one of the major challenges facing the LM approach is how to formulate the sentence models and accurately estimate their parameters for each sentence in the document to be summarized. In view of this, our work in this paper explores a novel use of recurrent neural network language modeling (RNNLM) framework for extractive broadcast news summarization. On top of such a framework, the deduced sentence models are able to render not only word usage cues but also long-span structural information of word co-occurrence relationships within broadcast news documents, getting around the need for the strict bag-of-words assumption. Furthermore, different model complexities and combinations are extensively analyzed and compared. Experimental results demonstrate the performance merits of our summarization methods when compared to several well-studied state-of-the-art unsupervised methods.

Original languageEnglish
Article number7111264
Pages (from-to)1322-1334
Number of pages13
JournalIEEE Transactions on Audio, Speech and Language Processing
Volume23
Issue number8
DOIs
Publication statusPublished - 2015 Aug 1

Keywords

  • Language modeling
  • long-span structural information
  • recurrent neural network
  • speech summarization

ASJC Scopus subject areas

  • Acoustics and Ultrasonics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Extractive broadcast news summarization leveraging recurrent neural network language modeling techniques'. Together they form a unique fingerprint.

Cite this