Learning-based movie summarization via role-community analysis and feature fusion

Jun Ying Li, Li Wei Kang, Chia Ming Tsai, Chia Wen Lin

研究成果: 書貢獻/報告類型會議論文篇章

6 引文 斯高帕斯(Scopus)

摘要

Movie summarization aims at condensing a full-length movie to a significantly shortened version that still preserves the movie's major semantic content. In this paper, we propose a learning-based movie summarization framework via role-community social network analysis and feature fusion. In our framework, scene-based movie summarization is formulated as a 0-1 knapsack problem, where the scene attention value for each significant scene is calculated as its value and the length of this scene is used as its cost. To identify the significance of each scene, we propose a learning-based approach to fuse the information derived from visual saliency (based on low-level features and high-level cognitive process for an input movie), high-level semantic analysis (based on the global and local social networks constructed from the movie), and user preferences. Our evaluation results show that in most test cases, the proposed method subjectively outperforms attention-based and role-based summarization methods and our previous role-community-based method in terms of semantic content preservation.

原文英語
主出版物標題2015 IEEE 17th International Workshop on Multimedia Signal Processing, MMSP 2015
發行者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子)9781467374781
DOIs
出版狀態已發佈 - 2015 十一月 30
對外發佈
事件17th IEEE International Workshop on Multimedia Signal Processing, MMSP 2015 - Xiamen, 中国
持續時間: 2015 十月 192015 十月 21

出版系列

名字2015 IEEE 17th International Workshop on Multimedia Signal Processing, MMSP 2015

會議

會議17th IEEE International Workshop on Multimedia Signal Processing, MMSP 2015
國家/地區中国
城市Xiamen
期間2015/10/192015/10/21

ASJC Scopus subject areas

  • 訊號處理
  • 媒體技術

指紋

深入研究「Learning-based movie summarization via role-community analysis and feature fusion」主題。共同形成了獨特的指紋。

引用此