A comparison of methods for detecting hot topics

Yuen Hsien Tseng, Yu I. Lin, Yi Yang Lee, Wen Chi Hung, Chun Hsiang Lee

Research output: Contribution to journalArticle

44 Citations (Scopus)

Abstract

In scientometrics for trend analysis, parameter choices for observing trends are often made ad hoc in past studies. For examples, different year spans might be used to create the time sequence and different indices were chosen for trend observation. However, the effectiveness of these choices was hardly known, quantitatively and comparatively. This work provides clues to better interpret the results when a certain choice was made. Specifically, by sorting research topics in decreasing order of interest predicted by a trend index and then by evaluating this ordering based on information retrieval measures, we compare a number of trend indices (percentage of increase vs. regression slope), trend formulations (simple trend vs. eigen-trend), and options (various year spans and durations for prediction) in different domains (safety agriculture and information retrieval) with different collection scales (72500 papers vs. 853 papers) to know which one leads to better trend observation. Our results show that the slope of linear regression on the time series performs constantly better than the others. More interestingly, this index is robust under different conditions and is hardly affected even when the collection was split into arbitrary (e.g., only two) periods. Implications of these results are discussed. Our work does not only provide a method to evaluate trend prediction performance for scientometrics, but also provides insights and reflections for past and future trend observation studies.

Original languageEnglish
Pages (from-to)73-90
Number of pages18
JournalScientometrics
Volume81
Issue number1
DOIs
Publication statusPublished - 2009 Oct

ASJC Scopus subject areas

  • Social Sciences(all)
  • Computer Science Applications
  • Library and Information Sciences

Fingerprint Dive into the research topics of 'A comparison of methods for detecting hot topics'. Together they form a unique fingerprint.

  • Cite this

    Tseng, Y. H., Lin, Y. I., Lee, Y. Y., Hung, W. C., & Lee, C. H. (2009). A comparison of methods for detecting hot topics. Scientometrics, 81(1), 73-90. https://doi.org/10.1007/s11192-009-1885-x