HEVC intra frame coding based on convolutional neural network

Chia Hung Yeh, Zheng Teng Zhang, Mei Juan Chen, Chih Yang Lin*

*此作品的通信作者

研究成果: 雜誌貢獻期刊論文同行評審

17 引文 斯高帕斯(Scopus)

摘要

The HEVC standard offers high performance with a lower bitrate for intra frame coding, but still requires many bits. An alternative intra frame coding framework based on convolutional neural network (CNN) is proposed in this paper. Two CNN models, simplified CNN (S-CNN) and complicated CNN (C-CNN), were designed and trained to improve the coding performance of HEVC. In intra frame coding, the trained CNN predicts the residual for reconstructed blocks to enhance visual quality. Due to the high computational complexity of CNN in HEVC encoding, we further explore the tradeoff between computational complexity and coding performance. For S-CNN, an early termination mechanism is proposed to further reduce the HEVC encoding complexity. With regard to C-CNN, a GPU-based heterogeneous architecture is proposed to accelerate CNN processing. Experimental results show that the proposed method with S-CNN achieves bitrate savings of 3.1% with a 37% increase in time cost, and 2.8% in bitrate savings with only a 23% increase in time cost when applying the early termination algorithm. In the case of C-CNN, the execution time of CNN can reach increases in speed of 8.8-17.8 × and a bitrate savings of up to 5.1% on average.

原文英語
文章編號8447192
頁(從 - 到)50087-50095
頁數9
期刊IEEE Access
6
DOIs
出版狀態已發佈 - 2018 8月 24

ASJC Scopus subject areas

  • 電腦科學(全部)
  • 材料科學(全部)
  • 工程 (全部)
  • 電氣與電子工程

指紋

深入研究「HEVC intra frame coding based on convolutional neural network」主題。共同形成了獨特的指紋。

引用此