Multi-Scale Deep Residual Learning-Based Single Image Haze Removal via Image Decomposition

Chia Hung Yeh, Chih Hsiang Huang, Li Wei Kang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Images/videos captured from outdoor visual devices are usually degraded by turbid media, such as haze, smoke, fog, rain, and snow. Haze is the most common one in outdoor scenes due to the atmosphere conditions. In this paper, a novel deep learning-based architecture (denoted by MSRL-DehazeNet) for single image haze removal relying on multi-scale residual learning (MSRL) and image decomposition is proposed. Instead of learning an end-to-end mapping between each pair of hazy image and its corresponding haze-free one adopted by most existing learning-based approaches, we reformulate the problem as restoration of the image base component. Based on the decomposition of a hazy image into the base and the detail components, haze removal (or dehazing) can be achieved by both of our multi-scale deep residual learning and our simplified U-Net learning only for mapping between hazy and haze-free base components, while the detail component is further enhanced via the other learned convolutional neural network (CNN). Moreover, benefited by the basic building block of our deep residual CNN architecture and our simplified U-Net structure, the feature maps (produced by extracting structural and statistical features), and each previous layer can be fully preserved and fed into the next layer. Therefore, possible color distortion in the recovered image would be avoided. As a result, the final haze-removed (or dehazed) image is obtained by integrating the haze-removed base and the enhanced detail image components. Experimental results have demonstrated good effectiveness of the proposed framework, compared with state-of-the-art approaches.

Original languageEnglish
Article number8931240
Pages (from-to)3153-3167
Number of pages15
JournalIEEE Transactions on Image Processing
Volume29
DOIs
Publication statusPublished - 2020

Keywords

  • convolutional neural networks
  • deep learning
  • deep residual learning
  • Haze removal
  • image decomposition
  • image restoration
  • single image dehazing
  • U-Net

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'Multi-Scale Deep Residual Learning-Based Single Image Haze Removal via Image Decomposition'. Together they form a unique fingerprint.

Cite this