An entropy-based query expansion approach for learning researchers' dynamic information needs

I. Chin Wu, Guan Wei Chen, Jia Lien Hsu, Chun Yu Lin

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Literature survey is one of the most important steps in the process of academic research, allowing researchers to explore and understand topics. However, novice researchers without sufficient prior knowledge lack the skills to determine proper keywords for searching topics of choice. To tackle this problem, we propose an entropy-based query expansion with a reweighting (E-QE) approach to revise queries during the iterative retrieval process. We designed a series of experiments that consider the researcher's changing information needs during task execution. Three topic change situations are considered in this work: minor, moderate and dramatic topic changes. The simulation-based pseudo-relevance feedback technique is applied during the search process to evaluate the effectiveness of the proposed approach without the intervention of human effort. We measured the effectiveness of the TFIDF and E-QE approaches for different types of topic change situations. The results show that the proposed E-QE approach achieves better search results than the TFIDF, helping researchers to revise queries. The results also confirm that the E-QE approach is effective when considering the relevant and irrelevant pages during the relevance feedback process at different levels of topic change.

Original languageEnglish
Pages (from-to)133-146
Number of pages14
JournalKnowledge-Based Systems
Volume52
DOIs
Publication statusPublished - 2013 Nov 1

Keywords

  • Entropy
  • Pseudo-relevance feedback
  • Query expansion
  • Term weighting
  • Topic change

ASJC Scopus subject areas

  • Management Information Systems
  • Software
  • Information Systems and Management
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'An entropy-based query expansion approach for learning researchers' dynamic information needs'. Together they form a unique fingerprint.

  • Cite this