Developing and evaluating Synctolearn, a fully automatic video and transcript synchronization tool for EFL learners

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

Authentic videos are always motivational for foreign language learners. According to the findings of many empirical studies, subtitled L2 videos are particularly useful for foreign language learning. Although there are many authentic English videos available on the Internet, most of these videos do not have subtitles. If subtitles can be added to videos, EFL students might better understand the video content and pick up more vocabulary items. To help EFL students make better use of authentic videos, an automatic video and transcript synchronization system called SynctoLearn was developed. The SynctoLearn system uses speech recognition technologies to automatically synchronize voices in audios and videos with their respective transcripts. Two studies were conducted in order to assess the effectiveness of this listening tool and investigate EFL learners' perception toward this device. In the first study, two college classes at similar proficiency levels were divided in two groups. One group viewed the synchronized video and another viewed the same video without any synchronized subtitles. The group that watched the synchronized video outperformed the other group in summarizing the key points of the video. In the second study, two college EFL classes used the SynctoLearn website for a whole semester and were invited to fill in a questionnaire. Based on the survey results, students indicated that they enjoyed watching synchronized videos. They regarded the design of the SynctoLearn system positively and particularly lauded the options that allowed them to click and replay any video segments and show/hide the subtitles at any time. Students, however, suggested that the video quality and subtitle presentation can be further improved. Moreover, additional learning support such as online dictionaries can be included in the system. The results of the experiment and the survey indicate that the SynctoLearn tool, which provides synchronized subtitles, can be used as a supporting tool to help EFL students reduce their cognitive loads and anxiety levels when tackling authentic videos. The findings and the technologies used in this article should be useful for teachers and researchers who want to use or develop similar tools for foreign language learning.

Original languageEnglish
Pages (from-to)117-130
Number of pages14
JournalComputer Assisted Language Learning
Volume24
Issue number2
DOIs
Publication statusPublished - 2011 Apr 1

Fingerprint

Synchronization
video
Students
Glossaries
Speech recognition
Websites
foreign language
Subtitles
EFL Learners
Internet
student
Group
learning
Experiments
dictionary
semester
website
vocabulary
Foreign Language Learning

Keywords

  • Authentic video
  • Automatic synchronization
  • Listening

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language
  • Computer Science Applications

Cite this

@article{5202758682024cc9b0147de475f36df6,
title = "Developing and evaluating Synctolearn, a fully automatic video and transcript synchronization tool for EFL learners",
abstract = "Authentic videos are always motivational for foreign language learners. According to the findings of many empirical studies, subtitled L2 videos are particularly useful for foreign language learning. Although there are many authentic English videos available on the Internet, most of these videos do not have subtitles. If subtitles can be added to videos, EFL students might better understand the video content and pick up more vocabulary items. To help EFL students make better use of authentic videos, an automatic video and transcript synchronization system called SynctoLearn was developed. The SynctoLearn system uses speech recognition technologies to automatically synchronize voices in audios and videos with their respective transcripts. Two studies were conducted in order to assess the effectiveness of this listening tool and investigate EFL learners' perception toward this device. In the first study, two college classes at similar proficiency levels were divided in two groups. One group viewed the synchronized video and another viewed the same video without any synchronized subtitles. The group that watched the synchronized video outperformed the other group in summarizing the key points of the video. In the second study, two college EFL classes used the SynctoLearn website for a whole semester and were invited to fill in a questionnaire. Based on the survey results, students indicated that they enjoyed watching synchronized videos. They regarded the design of the SynctoLearn system positively and particularly lauded the options that allowed them to click and replay any video segments and show/hide the subtitles at any time. Students, however, suggested that the video quality and subtitle presentation can be further improved. Moreover, additional learning support such as online dictionaries can be included in the system. The results of the experiment and the survey indicate that the SynctoLearn tool, which provides synchronized subtitles, can be used as a supporting tool to help EFL students reduce their cognitive loads and anxiety levels when tackling authentic videos. The findings and the technologies used in this article should be useful for teachers and researchers who want to use or develop similar tools for foreign language learning.",
keywords = "Authentic video, Automatic synchronization, Listening",
author = "Chen, {Hao Jan Howard}",
year = "2011",
month = "4",
day = "1",
doi = "10.1080/09588221.2010.526947",
language = "English",
volume = "24",
pages = "117--130",
journal = "Computer Assisted Language Learning",
issn = "0958-8221",
publisher = "Routledge",
number = "2",

}

TY - JOUR

T1 - Developing and evaluating Synctolearn, a fully automatic video and transcript synchronization tool for EFL learners

AU - Chen, Hao Jan Howard

PY - 2011/4/1

Y1 - 2011/4/1

N2 - Authentic videos are always motivational for foreign language learners. According to the findings of many empirical studies, subtitled L2 videos are particularly useful for foreign language learning. Although there are many authentic English videos available on the Internet, most of these videos do not have subtitles. If subtitles can be added to videos, EFL students might better understand the video content and pick up more vocabulary items. To help EFL students make better use of authentic videos, an automatic video and transcript synchronization system called SynctoLearn was developed. The SynctoLearn system uses speech recognition technologies to automatically synchronize voices in audios and videos with their respective transcripts. Two studies were conducted in order to assess the effectiveness of this listening tool and investigate EFL learners' perception toward this device. In the first study, two college classes at similar proficiency levels were divided in two groups. One group viewed the synchronized video and another viewed the same video without any synchronized subtitles. The group that watched the synchronized video outperformed the other group in summarizing the key points of the video. In the second study, two college EFL classes used the SynctoLearn website for a whole semester and were invited to fill in a questionnaire. Based on the survey results, students indicated that they enjoyed watching synchronized videos. They regarded the design of the SynctoLearn system positively and particularly lauded the options that allowed them to click and replay any video segments and show/hide the subtitles at any time. Students, however, suggested that the video quality and subtitle presentation can be further improved. Moreover, additional learning support such as online dictionaries can be included in the system. The results of the experiment and the survey indicate that the SynctoLearn tool, which provides synchronized subtitles, can be used as a supporting tool to help EFL students reduce their cognitive loads and anxiety levels when tackling authentic videos. The findings and the technologies used in this article should be useful for teachers and researchers who want to use or develop similar tools for foreign language learning.

AB - Authentic videos are always motivational for foreign language learners. According to the findings of many empirical studies, subtitled L2 videos are particularly useful for foreign language learning. Although there are many authentic English videos available on the Internet, most of these videos do not have subtitles. If subtitles can be added to videos, EFL students might better understand the video content and pick up more vocabulary items. To help EFL students make better use of authentic videos, an automatic video and transcript synchronization system called SynctoLearn was developed. The SynctoLearn system uses speech recognition technologies to automatically synchronize voices in audios and videos with their respective transcripts. Two studies were conducted in order to assess the effectiveness of this listening tool and investigate EFL learners' perception toward this device. In the first study, two college classes at similar proficiency levels were divided in two groups. One group viewed the synchronized video and another viewed the same video without any synchronized subtitles. The group that watched the synchronized video outperformed the other group in summarizing the key points of the video. In the second study, two college EFL classes used the SynctoLearn website for a whole semester and were invited to fill in a questionnaire. Based on the survey results, students indicated that they enjoyed watching synchronized videos. They regarded the design of the SynctoLearn system positively and particularly lauded the options that allowed them to click and replay any video segments and show/hide the subtitles at any time. Students, however, suggested that the video quality and subtitle presentation can be further improved. Moreover, additional learning support such as online dictionaries can be included in the system. The results of the experiment and the survey indicate that the SynctoLearn tool, which provides synchronized subtitles, can be used as a supporting tool to help EFL students reduce their cognitive loads and anxiety levels when tackling authentic videos. The findings and the technologies used in this article should be useful for teachers and researchers who want to use or develop similar tools for foreign language learning.

KW - Authentic video

KW - Automatic synchronization

KW - Listening

UR - http://www.scopus.com/inward/record.url?scp=79953142687&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79953142687&partnerID=8YFLogxK

U2 - 10.1080/09588221.2010.526947

DO - 10.1080/09588221.2010.526947

M3 - Article

AN - SCOPUS:79953142687

VL - 24

SP - 117

EP - 130

JO - Computer Assisted Language Learning

JF - Computer Assisted Language Learning

SN - 0958-8221

IS - 2

ER -