Multimedia recipe reading: Predicting learning outcomes and diagnosing cooking interest using eye-tracking measures

Ching Yeh Wang, Meng Jung Tsai, Chin Chung Tsai

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

This study aimed to explore the relationships between students' visual behaviors and learning outcomes, and between visual behaviors and prior cooking interest in multimedia recipe learning. An eye-tracking experiment, including pretest, recall test, and retention test, was conducted with a sample of 29 volunteer hospitality majors in Taiwan. The multimedia recipe included a static page showing the ingredients in a text-and-picture representation and a dynamic page showing the knife skills in a text-and-video representation. Total reading time, total fixation duration, number of fixations and inter-scanning count were used to explore the students' visual attention distributions among the different representation elements and their visual strategies for learning the recipe. The results showed that all students paid more visual attention to the text than to the picture information for the static recipe, and paid more visual attention to the video than to the text on the dynamic page. In addition, the visual attention paid to the text on the dynamic page was negatively correlated with the retention of the episodic knowledge of knife skills. In contrast, the visual attention paid to the text on the static ingredient page was positively correlated with students' prior cooking interest. Finally, the inter-scanning count between text and video on the dynamic page was the best index to negatively predict students' learning retention. Total fixation duration on the text information on the static page was the best index to positively predict students' prior cooking interest. Future studies and applications are discussed.

Original languageEnglish
Pages (from-to)9-18
Number of pages10
JournalComputers in Human Behavior
Volume62
DOIs
Publication statusPublished - 2016 Sep 1
Externally publishedYes

Fingerprint

Multimedia
Cooking
Reading
Learning
Students
Scanning
Taiwan
Learning Outcomes
Recipes
Volunteers
Visual Attention
Experiments

Keywords

  • Cooking interest
  • Eye movement
  • Multimedia learning
  • Recipe reading
  • Retention

ASJC Scopus subject areas

  • Arts and Humanities (miscellaneous)
  • Human-Computer Interaction
  • Psychology(all)

Cite this

Multimedia recipe reading : Predicting learning outcomes and diagnosing cooking interest using eye-tracking measures. / Wang, Ching Yeh; Tsai, Meng Jung; Tsai, Chin Chung.

In: Computers in Human Behavior, Vol. 62, 01.09.2016, p. 9-18.

Research output: Contribution to journalArticle

@article{78bcb93950504e74a395928a94fad3b8,
title = "Multimedia recipe reading: Predicting learning outcomes and diagnosing cooking interest using eye-tracking measures",
abstract = "This study aimed to explore the relationships between students' visual behaviors and learning outcomes, and between visual behaviors and prior cooking interest in multimedia recipe learning. An eye-tracking experiment, including pretest, recall test, and retention test, was conducted with a sample of 29 volunteer hospitality majors in Taiwan. The multimedia recipe included a static page showing the ingredients in a text-and-picture representation and a dynamic page showing the knife skills in a text-and-video representation. Total reading time, total fixation duration, number of fixations and inter-scanning count were used to explore the students' visual attention distributions among the different representation elements and their visual strategies for learning the recipe. The results showed that all students paid more visual attention to the text than to the picture information for the static recipe, and paid more visual attention to the video than to the text on the dynamic page. In addition, the visual attention paid to the text on the dynamic page was negatively correlated with the retention of the episodic knowledge of knife skills. In contrast, the visual attention paid to the text on the static ingredient page was positively correlated with students' prior cooking interest. Finally, the inter-scanning count between text and video on the dynamic page was the best index to negatively predict students' learning retention. Total fixation duration on the text information on the static page was the best index to positively predict students' prior cooking interest. Future studies and applications are discussed.",
keywords = "Cooking interest, Eye movement, Multimedia learning, Recipe reading, Retention",
author = "Wang, {Ching Yeh} and Tsai, {Meng Jung} and Tsai, {Chin Chung}",
year = "2016",
month = "9",
day = "1",
doi = "10.1016/j.chb.2016.03.064",
language = "English",
volume = "62",
pages = "9--18",
journal = "Computers in Human Behavior",
issn = "0747-5632",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Multimedia recipe reading

T2 - Predicting learning outcomes and diagnosing cooking interest using eye-tracking measures

AU - Wang, Ching Yeh

AU - Tsai, Meng Jung

AU - Tsai, Chin Chung

PY - 2016/9/1

Y1 - 2016/9/1

N2 - This study aimed to explore the relationships between students' visual behaviors and learning outcomes, and between visual behaviors and prior cooking interest in multimedia recipe learning. An eye-tracking experiment, including pretest, recall test, and retention test, was conducted with a sample of 29 volunteer hospitality majors in Taiwan. The multimedia recipe included a static page showing the ingredients in a text-and-picture representation and a dynamic page showing the knife skills in a text-and-video representation. Total reading time, total fixation duration, number of fixations and inter-scanning count were used to explore the students' visual attention distributions among the different representation elements and their visual strategies for learning the recipe. The results showed that all students paid more visual attention to the text than to the picture information for the static recipe, and paid more visual attention to the video than to the text on the dynamic page. In addition, the visual attention paid to the text on the dynamic page was negatively correlated with the retention of the episodic knowledge of knife skills. In contrast, the visual attention paid to the text on the static ingredient page was positively correlated with students' prior cooking interest. Finally, the inter-scanning count between text and video on the dynamic page was the best index to negatively predict students' learning retention. Total fixation duration on the text information on the static page was the best index to positively predict students' prior cooking interest. Future studies and applications are discussed.

AB - This study aimed to explore the relationships between students' visual behaviors and learning outcomes, and between visual behaviors and prior cooking interest in multimedia recipe learning. An eye-tracking experiment, including pretest, recall test, and retention test, was conducted with a sample of 29 volunteer hospitality majors in Taiwan. The multimedia recipe included a static page showing the ingredients in a text-and-picture representation and a dynamic page showing the knife skills in a text-and-video representation. Total reading time, total fixation duration, number of fixations and inter-scanning count were used to explore the students' visual attention distributions among the different representation elements and their visual strategies for learning the recipe. The results showed that all students paid more visual attention to the text than to the picture information for the static recipe, and paid more visual attention to the video than to the text on the dynamic page. In addition, the visual attention paid to the text on the dynamic page was negatively correlated with the retention of the episodic knowledge of knife skills. In contrast, the visual attention paid to the text on the static ingredient page was positively correlated with students' prior cooking interest. Finally, the inter-scanning count between text and video on the dynamic page was the best index to negatively predict students' learning retention. Total fixation duration on the text information on the static page was the best index to positively predict students' prior cooking interest. Future studies and applications are discussed.

KW - Cooking interest

KW - Eye movement

KW - Multimedia learning

KW - Recipe reading

KW - Retention

UR - http://www.scopus.com/inward/record.url?scp=84962740452&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962740452&partnerID=8YFLogxK

U2 - 10.1016/j.chb.2016.03.064

DO - 10.1016/j.chb.2016.03.064

M3 - Article

AN - SCOPUS:84962740452

VL - 62

SP - 9

EP - 18

JO - Computers in Human Behavior

JF - Computers in Human Behavior

SN - 0747-5632

ER -