Multi-hypothesis inspired super-resolution for compression distorted screen content image

Meng Wang; Jizheng Xu; Li Zhang; Junru Li; Shiqi Wang

doi:10.1117/12.2597132

1 August 2021 Multi-hypothesis inspired super-resolution for compression distorted screen content image

Meng Wang, Jizheng Xu, Li Zhang, Junru Li, Shiqi Wang

Proceedings Volume 11842, Applications of Digital Image Processing XLIV; 1184206 (2021) https://doi.org/10.1117/12.2597132
Event: SPIE Optical Engineering + Applications, 2021, San Diego, California, United States

Abstract

Multi-hypothesis-based prediction has been repetitively proven to be effective in improving prediction accuracy and enhancing coding performance. In this paper, we introduce the principle of multi-hypothesis to the super-resolution (SR) of compressed screen content images, with the goal of improving the restoration quality of the compression contaminated screen content images. More specifically, the super-resolution is achieved by a deep neural network. The deep neural network learns the mapping relationship between the compressed low-resolution (LR) image and the original high-resolution (HR) image. During learning process, we feed multiple LR patches for training, including the current patch and five neighboring patches, providing more informative clues for the learning of the high-quality restoration. In the inference process, input LR image will be translated with random offsets, yielding five assistant LR items for the SR of the input LR image. The LR and assistant LR items employ separate modules for feature extraction and then the features are fused with concatenation. Subsequently, the deep residual feature extraction is applied, which is composed of multiple consecutive residual blocks. Finally, the deep features are reconstructed with pixel shuffle, producing the SR image. Experimental results verify the effectiveness of the proposed multi-hypothesis-based SR scheme.

Conference Presentation

Citation Download Citation

Meng Wang, Jizheng Xu, Li Zhang, Junru Li, and Shiqi Wang "Multi-hypothesis inspired super-resolution for compression distorted screen content image", Proc. SPIE 11842, Applications of Digital Image Processing XLIV, 1184206 (1 August 2021); https://doi.org/10.1117/12.2597132

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available