2 May 2024 KT-NeRF: multi-view anti-motion blur neural radiance fields
Yining Wang, Jinyi Zhang, Yuxi Jiang
Author Affiliations +
Abstract

In the field of three-dimensional (3D) reconstruction, neural radiation fields (NeRF) can implicitly represent high-quality 3D scenes. However, traditional neural radiation fields place very high demands on the quality of the input images. When motion blurred images are input, the requirement of NeRF for multi-view consistency cannot be met, which results in a significant degradation in the quality of the 3D reconstruction. To address this problem, we propose KT-NeRF that extends NeRF to motion blur scenes. Based on the principle of motion blur, the method is derived from two-dimensional (2D) motion blurred images to 3D space. Then, Gaussian process regression model is introduced to estimate the motion trajectory of the camera for each motion blurred image, with the aim of learning accurate camera poses at key time stamps during the exposure time. The camera poses at the key time stamps are used as inputs to the NeRF in order to allow the NeRF to learn the blur information embedded in the images. Finally, the parameters of the Gaussian process regression model and the NeRF are jointly optimized to achieve multi-view anti-motion blur. The experiment shows that KT-NeRF achieved a peak signal-to-noise ratio of 29.4 and a structural similarity index of 0.85, an increase of 3.5% and 2.4%, respectively, over existing advanced methods. The learned perceptual image patch similarity was also reduced by 7.1% to 0.13.

© 2024 SPIE and IS&T
Yining Wang, Jinyi Zhang, and Yuxi Jiang "KT-NeRF: multi-view anti-motion blur neural radiance fields," Journal of Electronic Imaging 33(3), 033006 (2 May 2024). https://doi.org/10.1117/1.JEI.33.3.033006
Received: 29 September 2023; Accepted: 19 April 2024; Published: 2 May 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Cameras

3D modeling

Process modeling

Image processing

Motion models

Motion blur

3D image processing

Back to Top