FusionGAN-Detection: vehicle detection based on 3D-LIDAR and color camera data

Hao Zhang; Haiyang Hua

doi:10.1117/12.2611650

15 February 2022 FusionGAN-Detection: vehicle detection based on 3D-LIDAR and color camera data

Hao Zhang, Haiyang Hua

Proceedings Volume 12166, Seventh Asia Pacific Conference on Optics Manufacture and 2021 International Forum of Young Scientists on Advanced Optical Manufacturing (APCOM and YSAOM 2021); 121661D (2022) https://doi.org/10.1117/12.2611650
Event: Seventh Asia Pacific Conference on Optics Manufacture and 2021 International Forum of Young Scientists on Advanced Optical Manufacturing (APCOM and YSAOM 2021), 2021, Hong Kong, Hong Kong

Abstract

At present, most of the deep learning target detection methods based on multimodal information fusion are integrated, which makes the fusion image quality cannot be directly controlled. It is not conducive to strengthening the target detection of the network in principle. A multimodal information fusion detection method based on generative countermeasure network (FusionGAN-Detection) is proposed, which is composed of GAN and a target detection network. Aiming at the uncontrollability and blindness of existing information fusion detection algorithms, the new method introduces generative countermeasure network for information fusion. It uses loss function and dual discriminator to provide controllable guidance for generator. In the process of information fusion using GAN, the loss function of traditional thought can extract the information which is beneficial to target recognition to the maximum extent, and avoid the loss of channel information. The detector acts as a discriminator during the training process to guide image fusion and promote the improvement of image quality. Meanwhile, it acts as a target detector for target detection during testing. In order to verify the effectiveness of the method, KITTI data sets are used for training and testing. The experimental results show that new method is better than the existing advanced methods in AP.

Citation Download Citation

Hao Zhang and Haiyang Hua "FusionGAN-Detection: vehicle detection based on 3D-LIDAR and color camera data", Proc. SPIE 12166, Seventh Asia Pacific Conference on Optics Manufacture and 2021 International Forum of Young Scientists on Advanced Optical Manufacturing (APCOM and YSAOM 2021), 121661D (15 February 2022); https://doi.org/10.1117/12.2611650

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image fusion

Target detection

Sensors

Information fusion

RGB color model

LIDAR

Image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years