TY - JOUR
T1 - The application of content mining techniques to the analysis of educational evaluation research trends
AU - Tseng, Yuen Hsien
AU - Lin, Yu I.
PY - 2011/3
Y1 - 2011/3
N2 - Due to the mass accumulation of digital documents in nowadays research environment, related statistical or content mining methods for analyzing, organizing, and accessing information from the document collections are in great need. This research aimed to: (1) identify the core journals in the field of educational evaluation research through cross-verification of questionnaire survey and database searching; (2) find out major research topics and their evolutions by analyzing the publications in the core journals based on scientometrics methods such as citation analysis and text mining techniques. Based on the findings, the major salient research topics include principal's leadership, class size, evaluation, reform, teacher certification, opportunity to learn, retention, and voucher. And as to the issue of the evaluation methods, the studies conducted by Chen, Weiss, and Rossi are identified as newer ones than those by Cook and Compbell, which coincides with the fact shown in the evaluation theory tree (a sort of topical tree) organized by Marvin Alkin, an experienced expert in the field. Besides, with this topic trend analysis, it is also found that the number of papers dealing with the major research topics seems to be decreasing. However, all these results need to be interpreted by domain experts to reveal their true meanings. The methodology presented in this research may be applied not only to improve the efficiency of content analysis, but also to facilitate regular tracing of topic evolution, to spot the positions of important researchers in the field, and therefore to provide relevant clues or materials for further studies.
AB - Due to the mass accumulation of digital documents in nowadays research environment, related statistical or content mining methods for analyzing, organizing, and accessing information from the document collections are in great need. This research aimed to: (1) identify the core journals in the field of educational evaluation research through cross-verification of questionnaire survey and database searching; (2) find out major research topics and their evolutions by analyzing the publications in the core journals based on scientometrics methods such as citation analysis and text mining techniques. Based on the findings, the major salient research topics include principal's leadership, class size, evaluation, reform, teacher certification, opportunity to learn, retention, and voucher. And as to the issue of the evaluation methods, the studies conducted by Chen, Weiss, and Rossi are identified as newer ones than those by Cook and Compbell, which coincides with the fact shown in the evaluation theory tree (a sort of topical tree) organized by Marvin Alkin, an experienced expert in the field. Besides, with this topic trend analysis, it is also found that the number of papers dealing with the major research topics seems to be decreasing. However, all these results need to be interpreted by domain experts to reveal their true meanings. The methodology presented in this research may be applied not only to improve the efficiency of content analysis, but also to facilitate regular tracing of topic evolution, to spot the positions of important researchers in the field, and therefore to provide relevant clues or materials for further studies.
KW - Core journals
KW - Evaluation theory tree
KW - Scientometrics
KW - Topic detection
KW - Trend analysis
UR - http://www.scopus.com/inward/record.url?scp=84965102364&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84965102364&partnerID=8YFLogxK
M3 - Article
AN - SCOPUS:84965102364
SN - 2073-753X
VL - 56
SP - 129
EP - 166
JO - Journal of Research in Education Sciences
JF - Journal of Research in Education Sciences
IS - 1
ER -