High-speed 3D shape measurement with the multi-view system using deep learning

Wei Yin; Chao Zuo; Shijie Feng; Tianyang Tao; Qian Chen

doi:10.1117/12.2537573

18 November 2019 High-speed 3D shape measurement with the multi-view system using deep learning

Wei Yin, Chao Zuo, Shijie Feng, Tianyang Tao, Qian Chen

Proceedings Volume 11189, Optical Metrology and Inspection for Industrial Applications VI; 111890B (2019) https://doi.org/10.1117/12.2537573
Event: SPIE/COS Photonics Asia, 2019, Hangzhou, China

Abstract

In this paper, we propose a high-speed three dimensional (3D) shape measurement with the multi-view system using deep learning. Common stereo matching methods are based on block-matching or graph cuts to build the global correspondence of stereo images and obtain the dense disparity map. For fringe projection profilometry (FPP), a large number of stereo matching algorithms have been proposed to enhance the accuracy and computational efficiency of stereo matching and acquire the disparity map with sub-pixel precision by using phase constraint, geometric constraint, and depth constraint. However, the universality and precision of these methods are still not enough which is difficult to meet high-precision and high-efficient 3D measurement applications. Inspired by deep learning techniques, we demonstrate that the deep neural networks can learn to perform stereo matching after appropriate training, which substantially improves the reliability and efficiency of stereo matching compared with the traditional approach. Besides, to acquire 3D results with high performance, the optimal design of the patterns projected by the projector is discussed in detail, and the relative spatial positions between the cameras and the projector are carefully adjusted in our multi-view system. Experimental results demonstrate the stereo matching method using deep learning provides better matching efficiency to realize the absolute 3D measurement for objects with complex surfaces.

Citation Download Citation

Wei Yin, Chao Zuo, Shijie Feng, Tianyang Tao, and Qian Chen "High-speed 3D shape measurement with the multi-view system using deep learning", Proc. SPIE 11189, Optical Metrology and Inspection for Industrial Applications VI, 111890B (18 November 2019); https://doi.org/10.1117/12.2537573

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

3D metrology

Cameras

Neural networks

Fringe analysis

3D image processing

Imaging systems

Phase shifts

Show All Keywords

Keywords/Phrases

Search In:

Publication Years