Paper
25 May 2023 Image stitching based on a multistage keypoint matching and reconstruction network
Li Cheng, Hengyu Li, Jingyi Liu, Hongzhou Wang, Yueying Wang, Shaorong Xie
Author Affiliations +
Proceedings Volume 12636, Third International Conference on Machine Learning and Computer Application (ICMLCA 2022); 1263631 (2023) https://doi.org/10.1117/12.2675225
Event: Third International Conference on Machine Learning and Computer Application (ICMLCA 2022), 2022, Shenyang, China
Abstract
Image stitching is one of the important tasks of computer vision, which is used in many fields such as autonomous navigation and autonomous driving. However, traditional stitching methods rely too much on the quality of feature detection and show poor performance for images with few features or low resolution. Although existing deep learning-based methods can make up for the shortcomings of traditional methods, they are only used on mobile robots with smallbaseline or fixed perspectives. To address the above limitations, we propose an image stitching network consisting of three modules: multistage keypoint matching module, DFAST module and multistage image reconstruction module. First, we use a multistage keypoint matching module to align the reference image and the target image, and obtain deep homography estimates between reference and target images at different scales of features. After that, the DFAST module is designed to stitch images of arbitrary views and generate stitched feature maps at different scales. Finally, the multistage reconstruction network is used to reconstruct and optimize the stitched feature maps from feature level to pixel level and fuse stitched images of different scales to generate finer texture details. Experiments results show that our method surpasses previous methods including state-of-the-art traditional and CNN-based methods.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Li Cheng, Hengyu Li, Jingyi Liu, Hongzhou Wang, Yueying Wang, and Shaorong Xie "Image stitching based on a multistage keypoint matching and reconstruction network", Proc. SPIE 12636, Third International Conference on Machine Learning and Computer Application (ICMLCA 2022), 1263631 (25 May 2023); https://doi.org/10.1117/12.2675225
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Convolution

Image fusion

Deformation

Image processing

Feature fusion

Back to Top