Robust handwriting extraction and lecture video summarization

Greg C. Lee, Fu Hao Yeh, Ying Ju Chen, Tao Ku Chang

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

In e-Learning research, teachers can record lecture videos in e-class and upload these lecture videos to e-Learning system themselves. Once lecture videos and handouts can be generated automatically in traditional classroom, it can help students with self-learning and teacher with lecture content development for e-Learning services. This paper proposed a teaching assistant system based on computer vision that can help in content development for e-Learning services. Lecture videos are taken by using two cameras and merged on both sides so that students can see a clear and complete teaching content. The k-means segmentation is used to extract board area and then connected component technique helps refill the board area which is covered by lecturer’s body. Then we use adaptive threshold to extract handwritings in various light conditions and time-series denoising technique is designed to reduce noise. According to extracted handwritings, the lecture videos can be automatically structured with high level of semantics. The lecture videos are segmented into video clips and all key-frames are integrated as handouts of the education videos.

Original languageEnglish
Pages (from-to)7067-7085
Number of pages19
JournalMultimedia Tools and Applications
Volume76
Issue number5
DOIs
Publication statusPublished - 2017 Mar 1

Fingerprint

Teaching
Students
Computer vision
Learning systems
Time series
Education
Semantics
Cameras

Keywords

  • Image processing
  • Notes extraction
  • Video segmentation
  • Video summarization

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

Robust handwriting extraction and lecture video summarization. / Lee, Greg C.; Yeh, Fu Hao; Chen, Ying Ju; Chang, Tao Ku.

In: Multimedia Tools and Applications, Vol. 76, No. 5, 01.03.2017, p. 7067-7085.

Research output: Contribution to journalArticle

Lee, Greg C. ; Yeh, Fu Hao ; Chen, Ying Ju ; Chang, Tao Ku. / Robust handwriting extraction and lecture video summarization. In: Multimedia Tools and Applications. 2017 ; Vol. 76, No. 5. pp. 7067-7085.
@article{3f37ee21a0aa4173af2ff19ecc786f96,
title = "Robust handwriting extraction and lecture video summarization",
abstract = "In e-Learning research, teachers can record lecture videos in e-class and upload these lecture videos to e-Learning system themselves. Once lecture videos and handouts can be generated automatically in traditional classroom, it can help students with self-learning and teacher with lecture content development for e-Learning services. This paper proposed a teaching assistant system based on computer vision that can help in content development for e-Learning services. Lecture videos are taken by using two cameras and merged on both sides so that students can see a clear and complete teaching content. The k-means segmentation is used to extract board area and then connected component technique helps refill the board area which is covered by lecturer’s body. Then we use adaptive threshold to extract handwritings in various light conditions and time-series denoising technique is designed to reduce noise. According to extracted handwritings, the lecture videos can be automatically structured with high level of semantics. The lecture videos are segmented into video clips and all key-frames are integrated as handouts of the education videos.",
keywords = "Image processing, Notes extraction, Video segmentation, Video summarization",
author = "Lee, {Greg C.} and Yeh, {Fu Hao} and Chen, {Ying Ju} and Chang, {Tao Ku}",
year = "2017",
month = "3",
day = "1",
doi = "10.1007/s11042-016-3353-y",
language = "English",
volume = "76",
pages = "7067--7085",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",
number = "5",

}

TY - JOUR

T1 - Robust handwriting extraction and lecture video summarization

AU - Lee, Greg C.

AU - Yeh, Fu Hao

AU - Chen, Ying Ju

AU - Chang, Tao Ku

PY - 2017/3/1

Y1 - 2017/3/1

N2 - In e-Learning research, teachers can record lecture videos in e-class and upload these lecture videos to e-Learning system themselves. Once lecture videos and handouts can be generated automatically in traditional classroom, it can help students with self-learning and teacher with lecture content development for e-Learning services. This paper proposed a teaching assistant system based on computer vision that can help in content development for e-Learning services. Lecture videos are taken by using two cameras and merged on both sides so that students can see a clear and complete teaching content. The k-means segmentation is used to extract board area and then connected component technique helps refill the board area which is covered by lecturer’s body. Then we use adaptive threshold to extract handwritings in various light conditions and time-series denoising technique is designed to reduce noise. According to extracted handwritings, the lecture videos can be automatically structured with high level of semantics. The lecture videos are segmented into video clips and all key-frames are integrated as handouts of the education videos.

AB - In e-Learning research, teachers can record lecture videos in e-class and upload these lecture videos to e-Learning system themselves. Once lecture videos and handouts can be generated automatically in traditional classroom, it can help students with self-learning and teacher with lecture content development for e-Learning services. This paper proposed a teaching assistant system based on computer vision that can help in content development for e-Learning services. Lecture videos are taken by using two cameras and merged on both sides so that students can see a clear and complete teaching content. The k-means segmentation is used to extract board area and then connected component technique helps refill the board area which is covered by lecturer’s body. Then we use adaptive threshold to extract handwritings in various light conditions and time-series denoising technique is designed to reduce noise. According to extracted handwritings, the lecture videos can be automatically structured with high level of semantics. The lecture videos are segmented into video clips and all key-frames are integrated as handouts of the education videos.

KW - Image processing

KW - Notes extraction

KW - Video segmentation

KW - Video summarization

UR - http://www.scopus.com/inward/record.url?scp=84975767752&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84975767752&partnerID=8YFLogxK

U2 - 10.1007/s11042-016-3353-y

DO - 10.1007/s11042-016-3353-y

M3 - Article

AN - SCOPUS:84975767752

VL - 76

SP - 7067

EP - 7085

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

IS - 5

ER -