Imaging Components, Systems, and Processing

Colored three-dimensional reconstruction of vehicular thermal infrared images

[+] Author Affiliations
Shaoyuan Sun, Zhenyi Shen

Donghua University, College of Information Science and Technology, Department of Automation, No. 2999, North Renmin Road, Songjiang District, Shanghai 201620, China

Henry Leung

University of Calgary, Department of Electrical and Computer Engineering, 2500 University Drive NorthWest, Calgary T2N 1N4, Alberta, Canada

Opt. Eng. 54(6), 063102 (Jun 11, 2015). doi:10.1117/1.OE.54.6.063102
History: Received December 29, 2014; Accepted May 4, 2015
Text Size: A A A

Abstract.  Enhancement of vehicular night vision thermal infrared images is an important problem in intelligent vehicles. We propose to create a colorful three-dimensional (3-D) display of infrared images for the vehicular night vision assistant driving system. We combine the plane parameter Markov random field (PP-MRF) model-based depth estimation with classification-based infrared image colorization to perform colored 3-D reconstruction of vehicular thermal infrared images. We first train the PP-MRF model to learn the relationship between superpixel features and plane parameters. The infrared images are then colorized and we perform superpixel segmentation and feature extraction on the colorized images. The PP-MRF model is used to estimate the superpixel plane parameter and to analyze the structure of the superpixels according to the characteristics of vehicular thermal infrared images. Finally, we estimate the depth of each pixel to perform 3-D reconstruction. Experimental results demonstrate that the proposed method can give a visually pleasing and daytime-like colorful 3-D display from a monochromatic vehicular thermal infrared image, which can help drivers to have a better understanding of the environment.

Figures in this Article
© 2015 Society of Photo-Optical Instrumentation Engineers

Citation

Shaoyuan Sun ; Henry Leung and Zhenyi Shen
"Colored three-dimensional reconstruction of vehicular thermal infrared images", Opt. Eng. 54(6), 063102 (Jun 11, 2015). ; http://dx.doi.org/10.1117/1.OE.54.6.063102


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.