Deep learning-based compressed image artifacts reduction based on multi-scale image fusion

Chia Hung Yeh, Chu Han Lin, Min Hui Lin, Li Wei Kang*, Chih Hsiang Huang, Mei Juan Chen

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

One of the visually noticeable compression artifacts in block-based image/video compression platforms is called blocking artifact. Several post-processing methods were presented to reduce such kind of artifacts. However, most methods in the literature often induce visibly blurring artifacts. The paper presents a deep network to eliminate image compression artifacts (usually denoted by image deblocking) based on image fusion in multi-scale manner. Recent deep learning-based related methods usually learn deep models using a loss function in per-pixel manner based on explicit image priors in order to directly produce clean images. In place of existing deep learning-guided approaches, the problem is reformulated in this paper to the learning of the residuals (or artifacts) between the received images and their corresponding clean images (ground truths). In the presented deep framework, an input image is first down-sampled while naturally reducing the blocking artifacts. Then, our multi-scale image fusion model is used for fusing the different down-scaled versions (of less artifacts) with the input image (with severer artifacts) to estimate the blocking artifacts. Then, by deducting the estimated artifacts from the input image, the blocking artifacts can be significantly eliminated and most original image details are preserved simultaneously. The presented method is well applicable to any vision-based computer systems with digital visual codec embedded.

Original languageEnglish
Pages (from-to)195-207
Number of pages13
JournalInformation Fusion
Volume67
DOIs
Publication statusPublished - 2021 Mar

Keywords

  • Blocking artifacts
  • Convolutional neural networks
  • Deep learning
  • Image fusion
  • Multi-scale
  • Residual learning

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Information Systems
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Deep learning-based compressed image artifacts reduction based on multi-scale image fusion'. Together they form a unique fingerprint.

Cite this