Selecting Interesting Image Regions to Automatically Create Cinemagraphs

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

A cinemagraph is a novel medium that infuses a static image with the dynamics of one or several particular image regions. It is in many ways intermediate between a photograph and video, and it has numerous potential applications, such as in the creation of dynamic scenes in computer games and interactive environments. However, creating cinemagraphs is a time-consuming process requiring high proficiency in photo-editing techniques. This article presents a novel framework for automatically creating cinemagraphs from video sequences, with specific emphasis on determining the composition of masks and layers in creating aesthetically pleasing cinemagraphs. Treating video as a spatiotemporal data volume, the problem is considered a type of constrained optimization problem involving the discovery of a connected subgraph in video frames with maximal cumulative interestingness scores. The proposed framework accommodates multiple criteria describing qualities of interest in local image patches based on appearance and motion. Furthermore, the selected regions are not limited to certain shapes - the proposed approach facilitates capturing arbitrary objects. Experiments demonstrate the performance of the proposed approach. The findings of this study provide valuable information regarding various design choices for developing an easy and versatile authoring tool for cinemagraphs.

Original languageEnglish
Article number7018681
Pages (from-to)72-81
Number of pages10
JournalIEEE Multimedia
Volume23
Issue number1
DOIs
Publication statusPublished - 2016 Jan 1

Fingerprint

Computer games
Constrained optimization
Masks
Chemical analysis
Experiments

Keywords

  • cinemagraph
  • computational photography
  • graphics
  • multimedia
  • video processing
  • visualization

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Media Technology
  • Hardware and Architecture
  • Computer Science Applications

Cite this

Selecting Interesting Image Regions to Automatically Create Cinemagraphs. / Yeh, Mei-Chen.

In: IEEE Multimedia, Vol. 23, No. 1, 7018681, 01.01.2016, p. 72-81.

Research output: Contribution to journalArticle

@article{bdde16e430b64d2fa49c9f141d6424f2,
title = "Selecting Interesting Image Regions to Automatically Create Cinemagraphs",
abstract = "A cinemagraph is a novel medium that infuses a static image with the dynamics of one or several particular image regions. It is in many ways intermediate between a photograph and video, and it has numerous potential applications, such as in the creation of dynamic scenes in computer games and interactive environments. However, creating cinemagraphs is a time-consuming process requiring high proficiency in photo-editing techniques. This article presents a novel framework for automatically creating cinemagraphs from video sequences, with specific emphasis on determining the composition of masks and layers in creating aesthetically pleasing cinemagraphs. Treating video as a spatiotemporal data volume, the problem is considered a type of constrained optimization problem involving the discovery of a connected subgraph in video frames with maximal cumulative interestingness scores. The proposed framework accommodates multiple criteria describing qualities of interest in local image patches based on appearance and motion. Furthermore, the selected regions are not limited to certain shapes - the proposed approach facilitates capturing arbitrary objects. Experiments demonstrate the performance of the proposed approach. The findings of this study provide valuable information regarding various design choices for developing an easy and versatile authoring tool for cinemagraphs.",
keywords = "cinemagraph, computational photography, graphics, multimedia, video processing, visualization",
author = "Mei-Chen Yeh",
year = "2016",
month = "1",
day = "1",
doi = "10.1109/MMUL.2015.28",
language = "English",
volume = "23",
pages = "72--81",
journal = "IEEE Multimedia",
issn = "1070-986X",
publisher = "IEEE Computer Society",
number = "1",

}

TY - JOUR

T1 - Selecting Interesting Image Regions to Automatically Create Cinemagraphs

AU - Yeh, Mei-Chen

PY - 2016/1/1

Y1 - 2016/1/1

N2 - A cinemagraph is a novel medium that infuses a static image with the dynamics of one or several particular image regions. It is in many ways intermediate between a photograph and video, and it has numerous potential applications, such as in the creation of dynamic scenes in computer games and interactive environments. However, creating cinemagraphs is a time-consuming process requiring high proficiency in photo-editing techniques. This article presents a novel framework for automatically creating cinemagraphs from video sequences, with specific emphasis on determining the composition of masks and layers in creating aesthetically pleasing cinemagraphs. Treating video as a spatiotemporal data volume, the problem is considered a type of constrained optimization problem involving the discovery of a connected subgraph in video frames with maximal cumulative interestingness scores. The proposed framework accommodates multiple criteria describing qualities of interest in local image patches based on appearance and motion. Furthermore, the selected regions are not limited to certain shapes - the proposed approach facilitates capturing arbitrary objects. Experiments demonstrate the performance of the proposed approach. The findings of this study provide valuable information regarding various design choices for developing an easy and versatile authoring tool for cinemagraphs.

AB - A cinemagraph is a novel medium that infuses a static image with the dynamics of one or several particular image regions. It is in many ways intermediate between a photograph and video, and it has numerous potential applications, such as in the creation of dynamic scenes in computer games and interactive environments. However, creating cinemagraphs is a time-consuming process requiring high proficiency in photo-editing techniques. This article presents a novel framework for automatically creating cinemagraphs from video sequences, with specific emphasis on determining the composition of masks and layers in creating aesthetically pleasing cinemagraphs. Treating video as a spatiotemporal data volume, the problem is considered a type of constrained optimization problem involving the discovery of a connected subgraph in video frames with maximal cumulative interestingness scores. The proposed framework accommodates multiple criteria describing qualities of interest in local image patches based on appearance and motion. Furthermore, the selected regions are not limited to certain shapes - the proposed approach facilitates capturing arbitrary objects. Experiments demonstrate the performance of the proposed approach. The findings of this study provide valuable information regarding various design choices for developing an easy and versatile authoring tool for cinemagraphs.

KW - cinemagraph

KW - computational photography

KW - graphics

KW - multimedia

KW - video processing

KW - visualization

UR - http://www.scopus.com/inward/record.url?scp=84962618314&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962618314&partnerID=8YFLogxK

U2 - 10.1109/MMUL.2015.28

DO - 10.1109/MMUL.2015.28

M3 - Article

AN - SCOPUS:84962618314

VL - 23

SP - 72

EP - 81

JO - IEEE Multimedia

JF - IEEE Multimedia

SN - 1070-986X

IS - 1

M1 - 7018681

ER -