Quality-aware CNN-based in-loop filter for video coding

Wei Chen; Xiaoyu Xiu; Xianglin Wang; Yi-Wen Chen; Hong-Jheng Jhu; Che-Wei Kuo

doi:10.1117/12.2593380

1 August 2021 Quality-aware CNN-based in-loop filter for video coding

Wei Chen, Xiaoyu Xiu, Xianglin Wang, Yi-Wen Chen, Hong-Jheng Jhu, Che-Wei Kuo

Proceedings Volume 11842, Applications of Digital Image Processing XLIV; 1184203 (2021) https://doi.org/10.1117/12.2593380
Event: SPIE Optical Engineering + Applications, 2021, San Diego, California, United States

Abstract

The state‐of‐the‐art video coding standard, Versatile Video Coding (VVC) or H.266, has demonstrated its superior coding efficiency over its predecessor HEVC/H.265. In this paper, a novel in‐loop filter based on convolutional neural network (CNN) is illustrated to further improve the coding efficiency over VVC. In this filter, one single NN model is used to process multiple video components simultaneously. In addition, with a quality map generated for each video component as network input, the same single NN model is capable of processing videos in different qualities and resolutions while maintaining coding efficiency, which reduces the overall network complexity significantly. Simulation results show that the proposed approach provides average BD‐rate savings of 6.27%, 18.78% and 20.42% under AI configuration, and average BD-rate savings of 5.18%, 21.95% and 22.13% under RA configuration, respectively for Y, Cb and Cr components.

Conference Presentation

Citation Download Citation

Wei Chen, Xiaoyu Xiu, Xianglin Wang, Yi-Wen Chen, Hong-Jheng Jhu, and Che-Wei Kuo "Quality-aware CNN-based in-loop filter for video coding", Proc. SPIE 11842, Applications of Digital Image Processing XLIV, 1184203 (1 August 2021); https://doi.org/10.1117/12.2593380

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available