Image inpainting algorithm based on image decomposition model and patch global structural information

Lin Liu; Cuicui Ye; Kechao Wang; Zihan Liu; Yan Mao; Lihe Ma

doi:10.1117/12.2673237

13 April 2023 Image inpainting algorithm based on image decomposition model and patch global structural information

Lin Liu, Cuicui Ye, Kechao Wang, Zihan Liu, Yan Mao, Lihe Ma

Proceedings Volume 12605, 2022 2nd Conference on High Performance Computing and Communication Engineering (HPCCE 2022); 126050Z (2023) https://doi.org/10.1117/12.2673237
Event: Second Conference on High Performance Computing and Communication Engineering, 2022, Harbin, China

Abstract

With the improvement of image processing tools and the flexibility of digital image editing, automatic image inpainting has found important applications in computer vision and has also become an important and challenging topic of research in image processing. Through the analysis of the exemplar-based image inpainting method, we found the calculation of priority of image patches to fill is beneficial to the textures than the geometric structure, while the geometric structure is more important to the filling than the textures, resulting in the problem of texture extension or the discontinuity of the geometric structure in the image. The image decomposition model is applied to decompose the image to in paint into two components: texture and cartoon, which are then filled respectively. We improve the calculation of the priority of the texture component and the cartoon component, which make it suitable to the image character. In order to solve the mismatch problem, we propose a measurement based on global structure information of the target patch and the candidate patch in this paper. The mean and variance of the pixels in the image patch representing the global structure of image patches added to the measurement formula can improve the accuracy of the best matching patch to fill the missing region. We compared our model with the Criminisi algorithm and its improved one, through applying the algorithm to the synthetic images and the natural image. We also compute the PNSF and SSIM values between the original images and the inpainted images to verify the effectiveness of the proposed algorithm. The experimental results show that the proposed algorithm can get more perceptually aware in painted results than the Criminisi algorithm and its improved algorithm.

Citation Download Citation

Lin Liu, Cuicui Ye, Kechao Wang, Zihan Liu, Yan Mao, and Lihe Ma "Image inpainting algorithm based on image decomposition model and patch global structural information", Proc. SPIE 12605, 2022 2nd Conference on High Performance Computing and Communication Engineering (HPCCE 2022), 126050Z (13 April 2023); https://doi.org/10.1117/12.2673237

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Modal decomposition

Detection and tracking algorithms

Image quality

Image restoration

Digital image processing

Image processing

Discontinuities

Show All Keywords

Keywords/Phrases

Search In:

Publication Years