Multi-frame generative network for image super-resolution

Qisen Zhao; LiQuan Dong; Ming Liu; Xuhong Chu; Qingliang Jiao; Bu Ning; Lingqin Kong; Yuejin Zhao; Mei Hui

doi:10.1117/12.2612129

22 July 2022 Multi-frame generative network for image super-resolution

Qisen Zhao, LiQuan Dong, Ming Liu, Xuhong Chu, Qingliang Jiao, Bu Ning, Lingqin Kong, Yuejin Zhao, Mei Hui

Proceedings Volume 12277, 2021 International Conference on Optical Instruments and Technology: Optical Systems, Optoelectronic Instruments, Novel Display, and Imaging Technology; 122770O (2022) https://doi.org/10.1117/12.2612129
Event: 2021 International Conference on Optical Instruments and Technology, 2022, Online Only

Abstract

In recent years, the field of image super-resolution has mainly focused on the single-image super-resolution (SISR) task, which is to estimate an HR image from a single LR input. Due to the ill-posed ness of the SISR problem, these methods are limited to increasing the high-frequency details of the image by learning the a priori of the image. And multi-frame super-resolution (MFSR) provides the possibility to reconstruct rich details using the spatial and temporal difference information between images. With the increasing popularity of array camera technology, this key advantage makes MFSR an important issue for practical applications. We propose a new structure to complete the task of multi-frame image super-resolution. Our network takes multiple noisy images as input and generates a denoised, super-resolution RGB image as output. First, we align the multi-frame images by estimating the dense pixel optical flow between the images, and construct an adaptive fusion module to fuse the information of all frames. Then we build a feature fusion network to simultaneously fuse the depth feature information of multiple LR images and the internal features of the initial high-resolution image. In order to evaluate real-world data, We use the BurstSR data set, which includes real images of smartphones and highresolution SLR cameras, to prove the effectiveness of the proposed multiframe image super-resolution algorithm.

Citation Download Citation

Qisen Zhao, LiQuan Dong, Ming Liu, Xuhong Chu, Qingliang Jiao, Bu Ning, Lingqin Kong, Yuejin Zhao, and Mei Hui "Multi-frame generative network for image super-resolution", Proc. SPIE 12277, 2021 International Conference on Optical Instruments and Technology: Optical Systems, Optoelectronic Instruments, Novel Display, and Imaging Technology, 122770O (22 July 2022); https://doi.org/10.1117/12.2612129

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Super resolution

Image fusion

Image restoration

Image processing

Optical flow

Image sensors

Lawrencium

Show All Keywords

Keywords/Phrases

Search In:

Publication Years