Using eye-tracking as a means to evaluate visual and content design choices in web 2.0 - An initial finding from Livemocha

Gloria Shu Mei Chwo, Hong Fa Ho, Brian Chien Yi Liu, Sylvia Wen Lin Chiu

Research output: Contribution to conferencePaper

Abstract

In the evaluation of Web 2.0 language learning websites, various aspects to be evaluated are often distinguished, such as the visual design, the pedagogical content, and the involvement of multiple technologies (Liu et al., 2011). In order to make the evaluative judgments, the methods commonly used include expert judgment by inspection of the website, or user judgment obtained from surveys of learner attitude (Chwo, 2013). This study aims to add to this range of evaluation methods by exploiting a relatively new research tool, eyetracking (Reichle et. al, 2013), to help establish what options are in fact better. We took as an example the instructions presented on screen for various tasks and, based on the types given in the Livemocha website (Chwo et al., 2012), devised webpages allowing us to measure how four eye movement related effects differ with nine binary webpage choices ranging from visual design (e.g. dark or light background) to pedagogical content (e.g. presence or absence of a picture). Six Taiwanese learners of English major student participated. Results show that the titles, background colors and highlighted prints will increase our EFL (English as Foreign Language) learners' fixation frequency and the focal browsing time. However, the opposite result goes to the illustration relevant to the reading text. Moreover, the increasing number of the word count in the text will shorten the fixation frequency and focal browsing time. Lastly, the location of the illustration will not affect the browsing behaviors. The interpretation and the potential factors contributed to the findings will be discussed.

Original languageEnglish
Pages765-770
Number of pages6
Publication statusPublished - 2013 Jan 1
Event21st International Conference on Computers in Education, ICCE 2013 - Bali, Indonesia
Duration: 2013 Nov 182013 Nov 22

Other

Other21st International Conference on Computers in Education, ICCE 2013
CountryIndonesia
CityBali
Period13/11/1813/11/22

Fingerprint

Eye movements
website
Websites
evaluation
World Wide Web
foreign language
Inspection
expert
Students
instruction
Color
interpretation
language
learning
student
time

Keywords

  • Eye tracking
  • Livemocha
  • Visual interface design
  • Website function design

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Education

Cite this

Chwo, G. S. M., Ho, H. F., Liu, B. C. Y., & Chiu, S. W. L. (2013). Using eye-tracking as a means to evaluate visual and content design choices in web 2.0 - An initial finding from Livemocha. 765-770. Paper presented at 21st International Conference on Computers in Education, ICCE 2013, Bali, Indonesia.

Using eye-tracking as a means to evaluate visual and content design choices in web 2.0 - An initial finding from Livemocha. / Chwo, Gloria Shu Mei; Ho, Hong Fa; Liu, Brian Chien Yi; Chiu, Sylvia Wen Lin.

2013. 765-770 Paper presented at 21st International Conference on Computers in Education, ICCE 2013, Bali, Indonesia.

Research output: Contribution to conferencePaper

Chwo, GSM, Ho, HF, Liu, BCY & Chiu, SWL 2013, 'Using eye-tracking as a means to evaluate visual and content design choices in web 2.0 - An initial finding from Livemocha' Paper presented at 21st International Conference on Computers in Education, ICCE 2013, Bali, Indonesia, 13/11/18 - 13/11/22, pp. 765-770.
Chwo GSM, Ho HF, Liu BCY, Chiu SWL. Using eye-tracking as a means to evaluate visual and content design choices in web 2.0 - An initial finding from Livemocha. 2013. Paper presented at 21st International Conference on Computers in Education, ICCE 2013, Bali, Indonesia.
Chwo, Gloria Shu Mei ; Ho, Hong Fa ; Liu, Brian Chien Yi ; Chiu, Sylvia Wen Lin. / Using eye-tracking as a means to evaluate visual and content design choices in web 2.0 - An initial finding from Livemocha. Paper presented at 21st International Conference on Computers in Education, ICCE 2013, Bali, Indonesia.6 p.
@conference{990ff7b4b96d48299de5ce8de0da9767,
title = "Using eye-tracking as a means to evaluate visual and content design choices in web 2.0 - An initial finding from Livemocha",
abstract = "In the evaluation of Web 2.0 language learning websites, various aspects to be evaluated are often distinguished, such as the visual design, the pedagogical content, and the involvement of multiple technologies (Liu et al., 2011). In order to make the evaluative judgments, the methods commonly used include expert judgment by inspection of the website, or user judgment obtained from surveys of learner attitude (Chwo, 2013). This study aims to add to this range of evaluation methods by exploiting a relatively new research tool, eyetracking (Reichle et. al, 2013), to help establish what options are in fact better. We took as an example the instructions presented on screen for various tasks and, based on the types given in the Livemocha website (Chwo et al., 2012), devised webpages allowing us to measure how four eye movement related effects differ with nine binary webpage choices ranging from visual design (e.g. dark or light background) to pedagogical content (e.g. presence or absence of a picture). Six Taiwanese learners of English major student participated. Results show that the titles, background colors and highlighted prints will increase our EFL (English as Foreign Language) learners' fixation frequency and the focal browsing time. However, the opposite result goes to the illustration relevant to the reading text. Moreover, the increasing number of the word count in the text will shorten the fixation frequency and focal browsing time. Lastly, the location of the illustration will not affect the browsing behaviors. The interpretation and the potential factors contributed to the findings will be discussed.",
keywords = "Eye tracking, Livemocha, Visual interface design, Website function design",
author = "Chwo, {Gloria Shu Mei} and Ho, {Hong Fa} and Liu, {Brian Chien Yi} and Chiu, {Sylvia Wen Lin}",
year = "2013",
month = "1",
day = "1",
language = "English",
pages = "765--770",
note = "21st International Conference on Computers in Education, ICCE 2013 ; Conference date: 18-11-2013 Through 22-11-2013",

}

TY - CONF

T1 - Using eye-tracking as a means to evaluate visual and content design choices in web 2.0 - An initial finding from Livemocha

AU - Chwo, Gloria Shu Mei

AU - Ho, Hong Fa

AU - Liu, Brian Chien Yi

AU - Chiu, Sylvia Wen Lin

PY - 2013/1/1

Y1 - 2013/1/1

N2 - In the evaluation of Web 2.0 language learning websites, various aspects to be evaluated are often distinguished, such as the visual design, the pedagogical content, and the involvement of multiple technologies (Liu et al., 2011). In order to make the evaluative judgments, the methods commonly used include expert judgment by inspection of the website, or user judgment obtained from surveys of learner attitude (Chwo, 2013). This study aims to add to this range of evaluation methods by exploiting a relatively new research tool, eyetracking (Reichle et. al, 2013), to help establish what options are in fact better. We took as an example the instructions presented on screen for various tasks and, based on the types given in the Livemocha website (Chwo et al., 2012), devised webpages allowing us to measure how four eye movement related effects differ with nine binary webpage choices ranging from visual design (e.g. dark or light background) to pedagogical content (e.g. presence or absence of a picture). Six Taiwanese learners of English major student participated. Results show that the titles, background colors and highlighted prints will increase our EFL (English as Foreign Language) learners' fixation frequency and the focal browsing time. However, the opposite result goes to the illustration relevant to the reading text. Moreover, the increasing number of the word count in the text will shorten the fixation frequency and focal browsing time. Lastly, the location of the illustration will not affect the browsing behaviors. The interpretation and the potential factors contributed to the findings will be discussed.

AB - In the evaluation of Web 2.0 language learning websites, various aspects to be evaluated are often distinguished, such as the visual design, the pedagogical content, and the involvement of multiple technologies (Liu et al., 2011). In order to make the evaluative judgments, the methods commonly used include expert judgment by inspection of the website, or user judgment obtained from surveys of learner attitude (Chwo, 2013). This study aims to add to this range of evaluation methods by exploiting a relatively new research tool, eyetracking (Reichle et. al, 2013), to help establish what options are in fact better. We took as an example the instructions presented on screen for various tasks and, based on the types given in the Livemocha website (Chwo et al., 2012), devised webpages allowing us to measure how four eye movement related effects differ with nine binary webpage choices ranging from visual design (e.g. dark or light background) to pedagogical content (e.g. presence or absence of a picture). Six Taiwanese learners of English major student participated. Results show that the titles, background colors and highlighted prints will increase our EFL (English as Foreign Language) learners' fixation frequency and the focal browsing time. However, the opposite result goes to the illustration relevant to the reading text. Moreover, the increasing number of the word count in the text will shorten the fixation frequency and focal browsing time. Lastly, the location of the illustration will not affect the browsing behaviors. The interpretation and the potential factors contributed to the findings will be discussed.

KW - Eye tracking

KW - Livemocha

KW - Visual interface design

KW - Website function design

UR - http://www.scopus.com/inward/record.url?scp=84896484419&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84896484419&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:84896484419

SP - 765

EP - 770

ER -