Visual Perception Based Algorithm for Fast Depth Intra Coding of 3D-HEVC

Jie Ru Lin, Mei Juan Chen, Chia Hung Yeh, Yong Ci Chen, Lih Jen Kau, Chuan Yu Chang, Min Hui Lin

Research output: Contribution to journalArticlepeer-review

Abstract

3D-HEVC (The 3D Extension of High Efficiency Video Coding), is the newest 3D video coding standard, which enriches multimedia applications with the video format of multi-view plus depth. For the depth map coding in 3D-HEVC, the advanced coding tools enhance the coding efficiency of the depth map and the quality of the synthesized view. However, the time consumption and complexity of 3D-HEVC also increase significantly. This paper utilizes the characteristics of human visual system to propose a fast algorithm based on visual perception for the acceleration of the depth intra coding for 3D-HEVC. The depth map is segmented into different regions by Otsu's auto-thresholding. The dominate edge direction is categorized for each prediction unit. We detect the perceptual edge based on just noticeable depth difference model to extract the area that may affect the visual perception. According to depth map segmentation and edge distribution, we reduce the corresponding intra angular modes and determine whether to perform depth modelling mode. We also incorporate the boundary continuity and rate-distortion cost thresholding to propose the fast coding unit decision. The experimental results show that the proposed algorithm eliminates 53.09% of the depth coding time with only 0.15% BDBR on average. The coding performances of the proposed algorithm outperform previous works significantly.

Original languageEnglish
JournalIEEE Transactions on Multimedia
DOIs
Publication statusAccepted/In press - 2021

Keywords

  • 3D-HEVC
  • depth map
  • Encoding
  • Feature extraction
  • Image color analysis
  • Image edge detection
  • intra coding
  • intra prediction
  • perceptual coding
  • Prediction algorithms
  • Three-dimensional displays
  • Visualization

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Visual Perception Based Algorithm for Fast Depth Intra Coding of 3D-HEVC'. Together they form a unique fingerprint.

Cite this