9 April 2022 V-ShadowGAN: generative adversarial networks for removing and generating shadows associated with vehicles based on unpaired data
Ziyue Li, Hui Hu, Yijun Sun
Author Affiliations +
Abstract

We propose a method to change the shadows cast by vehicles based on unpaired data, which is used to solve the problem of insufficient datasets for target detection in autonomous driving scenarios. This method can increase the training samples of road vehicles in different time periods and reduce the time needed to make complex annotations of datasets. Direct use of generative adversarial networks with cycle-consistency constraints can achieve mapping transformation of unpaired domains, but it is difficult to completely learn the mapping between different shadow domains. To solve this problem, V-ShadowGAN is proposed. First, to train the model, we construct an unpaired dataset of vehicle shadows in different time periods. Second, the shadow mask extractor and the shadow mask discriminator are constructed to extract shadow masks and guide the generation of shadows in the network. Finally, the spatial attention mechanism is added to the generator, which improves the overall quality of the generated image by changing the channel weight of the network and deepening the network. Various experiments show that V-ShadowGAN can effectively change the vehicle shadow.

© 2022 SPIE and IS&T 1017-9909/2022/$28.00 © 2022 SPIE and IS&T
Ziyue Li, Hui Hu, and Yijun Sun "V-ShadowGAN: generative adversarial networks for removing and generating shadows associated with vehicles based on unpaired data," Journal of Electronic Imaging 31(2), 023028 (9 April 2022). https://doi.org/10.1117/1.JEI.31.2.023028
Received: 1 December 2021; Accepted: 22 March 2022; Published: 9 April 2022
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image quality

Roads

Sun

Gallium nitride

Image processing

Data modeling

Visualization

Back to Top