Monocular camera-based large field-of-view depth estimation for mobile machining of large aerospace components

Yuhan Tian; Jiacheng Cui; Lei Han; Yingxin Jiang; Yang Zhang; Wei Liu

doi:10.1117/12.2691544

6 November 2023 Monocular camera-based large field-of-view depth estimation for mobile machining of large aerospace components

Yuhan Tian, Jiacheng Cui, Lei Han, Yingxin Jiang, Yang Zhang, Wei Liu

Author Affiliations +

Proceedings Volume 12921, Third International Computing Imaging Conference (CITA 2023); 1292138 (2023) https://doi.org/10.1117/12.2691544
Event: Third International Computing Imaging Conference (CITA 2023), 2023, Sydney, Australia

Abstract

In the integrated processing of large components in the aerospace field, for the end servo industrial robot positioning accuracy needs, often using binocular vision positioning method. This method can accurately measure the end position but is limited by the restricted field of view and small depth of field. So, a monocular camera is needed for servo-guiding the processing end of the robot arm. Therefore, a monocular depth estimation method based on improved Yolov8 and CNN fusion for mobile machining with large field-of-view is proposed in this paper. Firstly, a dataset construction method based on virtual-real fusion is proposed to solve the problem that the depth information corresponding to the training set images is difficult to measure; secondly, the proposed Yolov8sim-CNN cascade neural network can realize the measurement of fast localization and depth prediction of the target machining workpiece and realize the servo-guidance of the robot arm end. The experimental results show that the proposed Yolov8sim-CNN network can ensure high detection accuracy, and the detection accuracy is substantially improved compared with the method of CNN-only, which indicates that the proposed method has better fitting ability and higher accuracy.

Citation Download Citation

Yuhan Tian, Jiacheng Cui, Lei Han, Yingxin Jiang, Yang Zhang, and Wei Liu "Monocular camera-based large field-of-view depth estimation for mobile machining of large aerospace components", Proc. SPIE 12921, Third International Computing Imaging Conference (CITA 2023), 1292138 (6 November 2023); https://doi.org/10.1117/12.2691544

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Neural networks

Cameras

Aerospace engineering

Image segmentation

Robotics

Image fusion

Target detection

Show All Keywords

Keywords/Phrases

Search In:

Publication Years