Video super-resolution via dynamic texture synthesis

Chih Chung Hsu, Li Wei Kang, Chia Wen Lin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

This paper addresses the problem of hallucinating the missing high-resolution (HR) details of a low-resolution (LR) video while maintaining the temporal coherence of the hallucinated HR details by using dynamic texture synthesis (DTS). Most existing multi-frame-based video super-resolution (SR) methods suffer from the problem of limited reconstructed visual quality due to inaccurate sub-pixel motion estimation between frames in a LR video. To achieve high-quality reconstruction of HR details for a LR video, we propose a texture-synthesis-based video super-resolution method, in which a novel DTS scheme is proposed to render the reconstructed HR details in a time coherent way, so as to effectively address the temporal incoherence problem caused by traditional texture synthesis based image SR methods. To further reduce the complexity of the proposed method, our method only performs the DTS-based SR on a selected set of key-frames, while the HR details of the remaining non-key-frames are simply predicted using the bi-directional overlapped block motion compensation. Experimental results demonstrate that the proposed method achieves significant subjective and objective quality improvement over state-of-the-art video SR methods.

Original languageEnglish
Title of host publication2014 IEEE International Workshop on Multimedia Signal Processing, MMSP 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479958962
DOIs
Publication statusPublished - 2014 Nov 14
Externally publishedYes
Event2014 16th IEEE International Workshop on Multimedia Signal Processing, MMSP 2014 - Jakarta, Indonesia
Duration: 2014 Sep 222014 Sep 24

Publication series

Name2014 IEEE International Workshop on Multimedia Signal Processing, MMSP 2014

Conference

Conference2014 16th IEEE International Workshop on Multimedia Signal Processing, MMSP 2014
Country/TerritoryIndonesia
CityJakarta
Period2014/09/222014/09/24

Keywords

  • Dynamic texture synthesis
  • Motion-compensated interpolation
  • Video hallucination
  • Video super-resolution
  • Video upscaling

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Signal Processing

Fingerprint

Dive into the research topics of 'Video super-resolution via dynamic texture synthesis'. Together they form a unique fingerprint.

Cite this