Learning-focused structuring for blackboard lecture videos

Yu Tzu Lin, Hsiao Ying Tsai, Chia Hu Chang, Greg C. Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Since blackboards are the standard in the classrooms and are still used today, blackboard lecture videos are common in the lecture video recordings. However, it has been known that content-based blackboard lecture video analysis is challenging and thereby rarely be touched upon in the field of semantic computing. In this paper, we proposed a new structuring method for blackboard lecture videos by estimating the learning focus that learners should pay more attention to. Both visual and aural analysis for blackboard lecture videos are utilized and integrated to develop a learning-focused attention model. As for the visual analysis, the fluctuation of written lecture content on the blackboard and the posture of lecturers are analyzed. On the other hand, the speech of lecturers is used for aural analysis. Finally, a learning-focused attention curve can be generated by fusing multiple attention models. In a sense, the values of the learning-focused attention reflect the strength of attention or semantics that the learners should pay to the blackboard lecture video and can be used for indicating the importance of the extracted lecture content at the corresponding time. Therefore, learners can easily access the blackboard lecture video with good flexibility to find what the lecture content they should understand and video frames to watch from the well-structured video. The experimental results show that the proposed method can effectively structure blackboard lecture videos and extract the lecture content with associated learning-focused attention values.

Original languageEnglish
Title of host publicationProceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010
Pages149-155
Number of pages7
DOIs
Publication statusPublished - 2010 Dec 1
Event4th IEEE International Conference on Semantic Computing, ICSC 2010 - Pittsburgh, PA, United States
Duration: 2010 Sep 222010 Sep 24

Publication series

NameProceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010

Other

Other4th IEEE International Conference on Semantic Computing, ICSC 2010
CountryUnited States
CityPittsburgh, PA
Period10/9/2210/9/24

Fingerprint

Semantics
Video recording
Video Analysis
Flexibility
Learning
Fluctuations
Curve
Computing
Experimental Results
Model
Vision

Keywords

  • Lecture video analysis
  • Semantic analysis
  • Visual attention modeling

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Theoretical Computer Science

Cite this

Lin, Y. T., Tsai, H. Y., Chang, C. H., & Lee, G. C. (2010). Learning-focused structuring for blackboard lecture videos. In Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010 (pp. 149-155). [5628802] (Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010). https://doi.org/10.1109/ICSC.2010.72

Learning-focused structuring for blackboard lecture videos. / Lin, Yu Tzu; Tsai, Hsiao Ying; Chang, Chia Hu; Lee, Greg C.

Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010. 2010. p. 149-155 5628802 (Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lin, YT, Tsai, HY, Chang, CH & Lee, GC 2010, Learning-focused structuring for blackboard lecture videos. in Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010., 5628802, Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010, pp. 149-155, 4th IEEE International Conference on Semantic Computing, ICSC 2010, Pittsburgh, PA, United States, 10/9/22. https://doi.org/10.1109/ICSC.2010.72
Lin YT, Tsai HY, Chang CH, Lee GC. Learning-focused structuring for blackboard lecture videos. In Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010. 2010. p. 149-155. 5628802. (Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010). https://doi.org/10.1109/ICSC.2010.72
Lin, Yu Tzu ; Tsai, Hsiao Ying ; Chang, Chia Hu ; Lee, Greg C. / Learning-focused structuring for blackboard lecture videos. Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010. 2010. pp. 149-155 (Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010).
@inproceedings{4d38162fe1014f39839006603ccba868,
title = "Learning-focused structuring for blackboard lecture videos",
abstract = "Since blackboards are the standard in the classrooms and are still used today, blackboard lecture videos are common in the lecture video recordings. However, it has been known that content-based blackboard lecture video analysis is challenging and thereby rarely be touched upon in the field of semantic computing. In this paper, we proposed a new structuring method for blackboard lecture videos by estimating the learning focus that learners should pay more attention to. Both visual and aural analysis for blackboard lecture videos are utilized and integrated to develop a learning-focused attention model. As for the visual analysis, the fluctuation of written lecture content on the blackboard and the posture of lecturers are analyzed. On the other hand, the speech of lecturers is used for aural analysis. Finally, a learning-focused attention curve can be generated by fusing multiple attention models. In a sense, the values of the learning-focused attention reflect the strength of attention or semantics that the learners should pay to the blackboard lecture video and can be used for indicating the importance of the extracted lecture content at the corresponding time. Therefore, learners can easily access the blackboard lecture video with good flexibility to find what the lecture content they should understand and video frames to watch from the well-structured video. The experimental results show that the proposed method can effectively structure blackboard lecture videos and extract the lecture content with associated learning-focused attention values.",
keywords = "Lecture video analysis, Semantic analysis, Visual attention modeling",
author = "Lin, {Yu Tzu} and Tsai, {Hsiao Ying} and Chang, {Chia Hu} and Lee, {Greg C.}",
year = "2010",
month = "12",
day = "1",
doi = "10.1109/ICSC.2010.72",
language = "English",
isbn = "9780769541549",
series = "Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010",
pages = "149--155",
booktitle = "Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010",

}

TY - GEN

T1 - Learning-focused structuring for blackboard lecture videos

AU - Lin, Yu Tzu

AU - Tsai, Hsiao Ying

AU - Chang, Chia Hu

AU - Lee, Greg C.

PY - 2010/12/1

Y1 - 2010/12/1

N2 - Since blackboards are the standard in the classrooms and are still used today, blackboard lecture videos are common in the lecture video recordings. However, it has been known that content-based blackboard lecture video analysis is challenging and thereby rarely be touched upon in the field of semantic computing. In this paper, we proposed a new structuring method for blackboard lecture videos by estimating the learning focus that learners should pay more attention to. Both visual and aural analysis for blackboard lecture videos are utilized and integrated to develop a learning-focused attention model. As for the visual analysis, the fluctuation of written lecture content on the blackboard and the posture of lecturers are analyzed. On the other hand, the speech of lecturers is used for aural analysis. Finally, a learning-focused attention curve can be generated by fusing multiple attention models. In a sense, the values of the learning-focused attention reflect the strength of attention or semantics that the learners should pay to the blackboard lecture video and can be used for indicating the importance of the extracted lecture content at the corresponding time. Therefore, learners can easily access the blackboard lecture video with good flexibility to find what the lecture content they should understand and video frames to watch from the well-structured video. The experimental results show that the proposed method can effectively structure blackboard lecture videos and extract the lecture content with associated learning-focused attention values.

AB - Since blackboards are the standard in the classrooms and are still used today, blackboard lecture videos are common in the lecture video recordings. However, it has been known that content-based blackboard lecture video analysis is challenging and thereby rarely be touched upon in the field of semantic computing. In this paper, we proposed a new structuring method for blackboard lecture videos by estimating the learning focus that learners should pay more attention to. Both visual and aural analysis for blackboard lecture videos are utilized and integrated to develop a learning-focused attention model. As for the visual analysis, the fluctuation of written lecture content on the blackboard and the posture of lecturers are analyzed. On the other hand, the speech of lecturers is used for aural analysis. Finally, a learning-focused attention curve can be generated by fusing multiple attention models. In a sense, the values of the learning-focused attention reflect the strength of attention or semantics that the learners should pay to the blackboard lecture video and can be used for indicating the importance of the extracted lecture content at the corresponding time. Therefore, learners can easily access the blackboard lecture video with good flexibility to find what the lecture content they should understand and video frames to watch from the well-structured video. The experimental results show that the proposed method can effectively structure blackboard lecture videos and extract the lecture content with associated learning-focused attention values.

KW - Lecture video analysis

KW - Semantic analysis

KW - Visual attention modeling

UR - http://www.scopus.com/inward/record.url?scp=79952046389&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79952046389&partnerID=8YFLogxK

U2 - 10.1109/ICSC.2010.72

DO - 10.1109/ICSC.2010.72

M3 - Conference contribution

AN - SCOPUS:79952046389

SN - 9780769541549

T3 - Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010

SP - 149

EP - 155

BT - Proceedings - 2010 IEEE 4th International Conference on Semantic Computing, ICSC 2010

ER -