Mobile-assisted learning experimental design: Current deficiencies and potential improvements

Yao Ting Sung; Han Yueh Lee; Je Ming Yang; Wei Cheng Chen; Hak Ping Tam; Yi Shian Lee

Mobile-assisted learning experimental design: Current deficiencies and potential improvements

Yao Ting Sung, Han Yueh Lee, Je Ming Yang, Wei Cheng Chen, Hak Ping Tam, Yi Shian Lee

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Due to the fact that mobile devices and educational software developed and expanded substantially in recent years, the importance of mobile-assisted learning may be raised. This study aimed to investigate the lack of the experimental design mobile-assisted leaning studies, and tried to make suggestions. Researchers collected all of the experimental studies on mobile-assisted learning published in ERIC and ISI from 2003 to 2013, which amounted to 216 studies. The four primary variables (research design, methods for initial equivalence in quasi-experiment, measuring tools and their reliability and validity, and sample size) were coded and preliminarily analyzed into frequency tables. Results of the study are as follows: (1) Researchers of 33.33% studies conducted the research by pre-experimental design or quasi-experimental design without equating, which were not rigorous sufficiently; (2) reliability and validity of outcome measures were not reported in 80% studies; and (3) sample sizes of approximate 30% studies were inadequate to draw an accurate statistical conclusion.

Original language	English
Title of host publication	Work-In-Progress Poster - Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014
Editors	Ahmad Fauzi Mohd Ayub, Akihiro Kashihara, Tatsunori Matsui, Chen-Chung Liu, Hiroaki Ogata, Siu Cheung Kong
Publisher	Asia-Pacific Society for Computers in Education
Pages	40-42
Number of pages	3
ISBN (Electronic)	9784990801441
Publication status	Published - 2014 Jan 1
Event	22nd International Conference on Computers in Education, ICCE 2014 - Nara, Japan Duration: 2014 Nov 30 → 2014 Dec 4

Other

Other	22nd International Conference on Computers in Education, ICCE 2014
Country	Japan
City	Nara
Period	2014/11/30 → 2014/12/04

Keywords

Design of experiments
Mobile-assisted learning
Rigorous

ASJC Scopus subject areas

Computer Science Applications
Education
Human-Computer Interaction

Fingerprint Dive into the research topics of 'Mobile-assisted learning experimental design: Current deficiencies and potential improvements'. Together they form a unique fingerprint.

Cite this

Sung, Y. T., Lee, H. Y., Yang, J. M., Chen, W. C., Tam, H. P., & Lee, Y. S. (2014). Mobile-assisted learning experimental design: Current deficiencies and potential improvements. In A. F. Mohd Ayub, A. Kashihara, T. Matsui, C-C. Liu, H. Ogata, & S. C. Kong (Eds.), Work-In-Progress Poster - Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014 (pp. 40-42). Asia-Pacific Society for Computers in Education.

Mobile-assisted learning experimental design : Current deficiencies and potential improvements. / Sung, Yao Ting; Lee, Han Yueh; Yang, Je Ming; Chen, Wei Cheng; Tam, Hak Ping; Lee, Yi Shian.

Work-In-Progress Poster - Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014. ed. / Ahmad Fauzi Mohd Ayub; Akihiro Kashihara; Tatsunori Matsui; Chen-Chung Liu; Hiroaki Ogata; Siu Cheung Kong. Asia-Pacific Society for Computers in Education, 2014. p. 40-42.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Sung, YT, Lee, HY, Yang, JM, Chen, WC, Tam, HP & Lee, YS 2014, Mobile-assisted learning experimental design: Current deficiencies and potential improvements. in AF Mohd Ayub, A Kashihara, T Matsui, C-C Liu, H Ogata & SC Kong (eds), Work-In-Progress Poster - Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014. Asia-Pacific Society for Computers in Education, pp. 40-42, 22nd International Conference on Computers in Education, ICCE 2014, Nara, Japan, 2014/11/30.

Sung YT, Lee HY, Yang JM, Chen WC, Tam HP, Lee YS. Mobile-assisted learning experimental design: Current deficiencies and potential improvements. In Mohd Ayub AF, Kashihara A, Matsui T, Liu C-C, Ogata H, Kong SC, editors, Work-In-Progress Poster - Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014. Asia-Pacific Society for Computers in Education. 2014. p. 40-42

Sung, Yao Ting ; Lee, Han Yueh ; Yang, Je Ming ; Chen, Wei Cheng ; Tam, Hak Ping ; Lee, Yi Shian. / Mobile-assisted learning experimental design : Current deficiencies and potential improvements. Work-In-Progress Poster - Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014. editor / Ahmad Fauzi Mohd Ayub ; Akihiro Kashihara ; Tatsunori Matsui ; Chen-Chung Liu ; Hiroaki Ogata ; Siu Cheung Kong. Asia-Pacific Society for Computers in Education, 2014. pp. 40-42

@inproceedings{519445509c75440c8180e06f7fdc2bfb,

title = "Mobile-assisted learning experimental design: Current deficiencies and potential improvements",

abstract = "Due to the fact that mobile devices and educational software developed and expanded substantially in recent years, the importance of mobile-assisted learning may be raised. This study aimed to investigate the lack of the experimental design mobile-assisted leaning studies, and tried to make suggestions. Researchers collected all of the experimental studies on mobile-assisted learning published in ERIC and ISI from 2003 to 2013, which amounted to 216 studies. The four primary variables (research design, methods for initial equivalence in quasi-experiment, measuring tools and their reliability and validity, and sample size) were coded and preliminarily analyzed into frequency tables. Results of the study are as follows: (1) Researchers of 33.33% studies conducted the research by pre-experimental design or quasi-experimental design without equating, which were not rigorous sufficiently; (2) reliability and validity of outcome measures were not reported in 80% studies; and (3) sample sizes of approximate 30% studies were inadequate to draw an accurate statistical conclusion.",

keywords = "Design of experiments, Mobile-assisted learning, Rigorous",

author = "Sung, {Yao Ting} and Lee, {Han Yueh} and Yang, {Je Ming} and Chen, {Wei Cheng} and Tam, {Hak Ping} and Lee, {Yi Shian}",

year = "2014",

month = jan,

day = "1",

language = "English",

pages = "40--42",

editor = "{Mohd Ayub}, {Ahmad Fauzi} and Akihiro Kashihara and Tatsunori Matsui and Chen-Chung Liu and Hiroaki Ogata and Kong, {Siu Cheung}",

booktitle = "Work-In-Progress Poster - Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014",

publisher = "Asia-Pacific Society for Computers in Education",

note = "22nd International Conference on Computers in Education, ICCE 2014 ; Conference date: 30-11-2014 Through 04-12-2014",

}

TY - GEN

T1 - Mobile-assisted learning experimental design

T2 - 22nd International Conference on Computers in Education, ICCE 2014

AU - Sung, Yao Ting

AU - Lee, Han Yueh

AU - Yang, Je Ming

AU - Chen, Wei Cheng

AU - Tam, Hak Ping

AU - Lee, Yi Shian

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Due to the fact that mobile devices and educational software developed and expanded substantially in recent years, the importance of mobile-assisted learning may be raised. This study aimed to investigate the lack of the experimental design mobile-assisted leaning studies, and tried to make suggestions. Researchers collected all of the experimental studies on mobile-assisted learning published in ERIC and ISI from 2003 to 2013, which amounted to 216 studies. The four primary variables (research design, methods for initial equivalence in quasi-experiment, measuring tools and their reliability and validity, and sample size) were coded and preliminarily analyzed into frequency tables. Results of the study are as follows: (1) Researchers of 33.33% studies conducted the research by pre-experimental design or quasi-experimental design without equating, which were not rigorous sufficiently; (2) reliability and validity of outcome measures were not reported in 80% studies; and (3) sample sizes of approximate 30% studies were inadequate to draw an accurate statistical conclusion.

AB - Due to the fact that mobile devices and educational software developed and expanded substantially in recent years, the importance of mobile-assisted learning may be raised. This study aimed to investigate the lack of the experimental design mobile-assisted leaning studies, and tried to make suggestions. Researchers collected all of the experimental studies on mobile-assisted learning published in ERIC and ISI from 2003 to 2013, which amounted to 216 studies. The four primary variables (research design, methods for initial equivalence in quasi-experiment, measuring tools and their reliability and validity, and sample size) were coded and preliminarily analyzed into frequency tables. Results of the study are as follows: (1) Researchers of 33.33% studies conducted the research by pre-experimental design or quasi-experimental design without equating, which were not rigorous sufficiently; (2) reliability and validity of outcome measures were not reported in 80% studies; and (3) sample sizes of approximate 30% studies were inadequate to draw an accurate statistical conclusion.

KW - Design of experiments

KW - Mobile-assisted learning

KW - Rigorous

UR - http://www.scopus.com/inward/record.url?scp=84923920234&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84923920234&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84923920234

SP - 40

EP - 42

BT - Work-In-Progress Poster - Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014

A2 - Mohd Ayub, Ahmad Fauzi

A2 - Kashihara, Akihiro

A2 - Matsui, Tatsunori

A2 - Liu, Chen-Chung

A2 - Ogata, Hiroaki

A2 - Kong, Siu Cheung

PB - Asia-Pacific Society for Computers in Education

Y2 - 30 November 2014 through 4 December 2014

ER -