Restoration of lighting sources for virtual reality systems using convolutional neural networks, computer vision algorithms, and disparity maps

M. Sorokin; D. Zhdanov; A. Zhdanov

doi:10.1117/12.2575396

10 October 2020 Restoration of lighting sources for virtual reality systems using convolutional neural networks, computer vision algorithms, and disparity maps

M. Sorokin, D. Zhdanov, A. Zhdanov

Author Affiliations +

Proceedings Volume 11550, Optoelectronic Imaging and Multimedia Technology VII; 115500L (2020) https://doi.org/10.1117/12.2575396
Event: SPIE/COS Photonics Asia, 2020, Online Only

Abstract

The current work is dedicated to solving one of the problems for virtual reality systems - restoring the coordinates of light sources for rendering realistic images of the resulting scene. In this paper, we propose approaches based on convolutional neural networks, computer vision algorithms, algorithms based on the intersection of rays from the shadow of images and disparity maps to find the exact location of the light source and the power of its illumination. For easy use of the algorithms, a GUI application was developed that allows to select the necessary operating modes and evaluate the speed of their work.

Conference Presentation

Citation Download Citation

M. Sorokin, D. Zhdanov, and A. Zhdanov "Restoration of lighting sources for virtual reality systems using convolutional neural networks, computer vision algorithms, and disparity maps", Proc. SPIE 11550, Optoelectronic Imaging and Multimedia Technology VII, 115500L (10 October 2020); https://doi.org/10.1117/12.2575396

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available