Improved Chinese spoken document retrieval with hybrid modeling and data-driven indexing features

Chun Jen Wang, Berlin Chen, Lin Shan Lee

Research output: Contribution to conferencePaper

5 Citations (Scopus)

Abstract

Different models retrieve the documents based on different approaches of extracting the underlying content. Different levels of indexing features also offer different functionalities and discriminabilities when retrieving the documents. In this paper, we present results for Chinese spoken document retrieval with hybrid models to integrate the knowledge obtainable from three basic retrieval models, namely, the standard vector space model (VSM), the hidden Markov model (HMM), and the latent semantic indexing (LSI) model. The characteristics of retrieval performance using both word-level and syllable-level indexing features were extensively explored. In addition, a data-driven approach to derive variable-length indexing features is also presented. Very satisfactory performance can be achieved with these data-driven features while retaining very compact feature set size. Experiments showed that this approach has the potential to identify domain-specific terminologies or newlygenerated phrases. It is therefore very useful not only in Chinese document retrieval, but also in detecting out of vocabulary (OOV) words in Chinese. Very encouraging results were obtained when the hybrid models were used with the datadriven indexing features as well.

Original languageEnglish
Pages1985-1988
Number of pages4
Publication statusPublished - 2002 Jan 1
Event7th International Conference on Spoken Language Processing, ICSLP 2002 - Denver, United States
Duration: 2002 Sep 162002 Sep 20

Other

Other7th International Conference on Spoken Language Processing, ICSLP 2002
CountryUnited States
CityDenver
Period02/9/1602/9/20

    Fingerprint

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language

Cite this

Wang, C. J., Chen, B., & Lee, L. S. (2002). Improved Chinese spoken document retrieval with hybrid modeling and data-driven indexing features. 1985-1988. Paper presented at 7th International Conference on Spoken Language Processing, ICSLP 2002, Denver, United States.