Meta-analysis of response time data in a single experiment

Research output: Contribution to journalArticle

Abstract

Conventional analysis based on mean response times does not fully utilize data and also ignores the difference in precision among the means by weighting each mean equally. A meta-analysis was applied to the reaction time data obtained from the Stroop color-naming task in a single experiment which employed a mixed design. It treated each subject as an independent replication of the same experiment and the same hypothesis. Individual subjects' data were first analyzed with a time-series regression adjusting for lag 1 autocorrelation. Results from these analyses were, then, combined to estimate the over-all effect size as well as significance level. A between-subject factor was also analyzed to assess its influence on the effect sizes and the significance levels. When these analyses were contrasted with the conventional analysis of mean reaction times, the meta-analysis based on reaction times of individual trials yielded a more powerful test of the research hypotheses than the conventional analysis based on mean reaction times for these trials. The advantages and possible limitations of the within-study meta-analysis are discussed.

Original languageEnglish
Pages (from-to)1103-1113
Number of pages11
JournalPsychological Reports
Volume81
Issue numberSUPPL. 2
Publication statusPublished - 1997 Dec 1

Fingerprint

Reaction Time
Meta-Analysis
Color
Research

ASJC Scopus subject areas

  • Psychology(all)

Cite this

Meta-analysis of response time data in a single experiment. / Chen, Jenn-Yeu.

In: Psychological Reports, Vol. 81, No. SUPPL. 2, 01.12.1997, p. 1103-1113.

Research output: Contribution to journalArticle

@article{96698645768b4379a602bdfd1f88bb66,
title = "Meta-analysis of response time data in a single experiment",
abstract = "Conventional analysis based on mean response times does not fully utilize data and also ignores the difference in precision among the means by weighting each mean equally. A meta-analysis was applied to the reaction time data obtained from the Stroop color-naming task in a single experiment which employed a mixed design. It treated each subject as an independent replication of the same experiment and the same hypothesis. Individual subjects' data were first analyzed with a time-series regression adjusting for lag 1 autocorrelation. Results from these analyses were, then, combined to estimate the over-all effect size as well as significance level. A between-subject factor was also analyzed to assess its influence on the effect sizes and the significance levels. When these analyses were contrasted with the conventional analysis of mean reaction times, the meta-analysis based on reaction times of individual trials yielded a more powerful test of the research hypotheses than the conventional analysis based on mean reaction times for these trials. The advantages and possible limitations of the within-study meta-analysis are discussed.",
author = "Jenn-Yeu Chen",
year = "1997",
month = "12",
day = "1",
language = "English",
volume = "81",
pages = "1103--1113",
journal = "Psychological Reports",
issn = "0033-2941",
publisher = "Ammons Scientific Ltd",
number = "SUPPL. 2",

}

TY - JOUR

T1 - Meta-analysis of response time data in a single experiment

AU - Chen, Jenn-Yeu

PY - 1997/12/1

Y1 - 1997/12/1

N2 - Conventional analysis based on mean response times does not fully utilize data and also ignores the difference in precision among the means by weighting each mean equally. A meta-analysis was applied to the reaction time data obtained from the Stroop color-naming task in a single experiment which employed a mixed design. It treated each subject as an independent replication of the same experiment and the same hypothesis. Individual subjects' data were first analyzed with a time-series regression adjusting for lag 1 autocorrelation. Results from these analyses were, then, combined to estimate the over-all effect size as well as significance level. A between-subject factor was also analyzed to assess its influence on the effect sizes and the significance levels. When these analyses were contrasted with the conventional analysis of mean reaction times, the meta-analysis based on reaction times of individual trials yielded a more powerful test of the research hypotheses than the conventional analysis based on mean reaction times for these trials. The advantages and possible limitations of the within-study meta-analysis are discussed.

AB - Conventional analysis based on mean response times does not fully utilize data and also ignores the difference in precision among the means by weighting each mean equally. A meta-analysis was applied to the reaction time data obtained from the Stroop color-naming task in a single experiment which employed a mixed design. It treated each subject as an independent replication of the same experiment and the same hypothesis. Individual subjects' data were first analyzed with a time-series regression adjusting for lag 1 autocorrelation. Results from these analyses were, then, combined to estimate the over-all effect size as well as significance level. A between-subject factor was also analyzed to assess its influence on the effect sizes and the significance levels. When these analyses were contrasted with the conventional analysis of mean reaction times, the meta-analysis based on reaction times of individual trials yielded a more powerful test of the research hypotheses than the conventional analysis based on mean reaction times for these trials. The advantages and possible limitations of the within-study meta-analysis are discussed.

UR - http://www.scopus.com/inward/record.url?scp=0346614609&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0346614609&partnerID=8YFLogxK

M3 - Article

C2 - 9461743

AN - SCOPUS:0346614609

VL - 81

SP - 1103

EP - 1113

JO - Psychological Reports

JF - Psychological Reports

SN - 0033-2941

IS - SUPPL. 2

ER -