2 May 2024 KT-NeRF: multi-view anti-motion blur neural radiance fields
Yining Wang, Jinyi Zhang, Yuxi Jiang
Author Affiliations +
Abstract

In the field of three-dimensional (3D) reconstruction, neural radiation fields (NeRF) can implicitly represent high-quality 3D scenes. However, traditional neural radiation fields place very high demands on the quality of the input images. When motion blurred images are input, the requirement of NeRF for multi-view consistency cannot be met, which results in a significant degradation in the quality of the 3D reconstruction. To address this problem, we propose KT-NeRF that extends NeRF to motion blur scenes. Based on the principle of motion blur, the method is derived from two-dimensional (2D) motion blurred images to 3D space. Then, Gaussian process regression model is introduced to estimate the motion trajectory of the camera for each motion blurred image, with the aim of learning accurate camera poses at key time stamps during the exposure time. The camera poses at the key time stamps are used as inputs to the NeRF in order to allow the NeRF to learn the blur information embedded in the images. Finally, the parameters of the Gaussian process regression model and the NeRF are jointly optimized to achieve multi-view anti-motion blur. The experiment shows that KT-NeRF achieved a peak signal-to-noise ratio of 29.4 and a structural similarity index of 0.85, an increase of 3.5% and 2.4%, respectively, over existing advanced methods. The learned perceptual image patch similarity was also reduced by 7.1% to 0.13.

© 2024 SPIE and IS&T
Yining Wang, Jinyi Zhang, and Yuxi Jiang "KT-NeRF: multi-view anti-motion blur neural radiance fields," Journal of Electronic Imaging 33(3), 033006 (2 May 2024). https://doi.org/10.1117/1.JEI.33.3.033006
Received: 29 September 2023; Accepted: 19 April 2024; Published: 2 May 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Cameras

3D modeling

Process modeling

Image processing

Motion models

Motion blur

3D image processing

RELATED CONTENT

Model for shape and motion perception
Proceedings of SPIE (February 14 1992)
Automatic modeling of 3 D moving objects from a TV...
Proceedings of SPIE (January 01 1990)
Polynomial methods for SfM assuming central projection
Proceedings of SPIE (December 28 1998)
Stochastic structure estimation by motion
Proceedings of SPIE (November 01 1992)
Model-based multiple-sensor dynamic scene interpretation
Proceedings of SPIE (February 01 1992)

Back to Top