9 September 2024 Shadow-aware terrain classification: advancing hyperspectral image sensing through generative adversarial networks and correlated sample synthesis
Author Affiliations +
Abstract

In recent years, the utilization of hyperspectral sensors for remote sensing has marked a profound advancement due to the success of machine learning techniques. Nevertheless, difficulties still exist, especially in locations with shadows. The heterogeneity in spectral data due to different shadow origins, such as different types of clouds and different building designs, poses a significant obstacle to the advancement of shadow-aware classification algorithms. Furthermore, precisely labeling the underlying structures in shadowed areas is a very cumbersome effort. We present a loss function-based strategy based on generative adversarial networks to address this problem. Using the context of correlated samples, our loss function combines unpaired matchings and transitive style modifications via the fusion of contrastive learning, dual learning, cycle consistency, and curriculum learning algorithms. Our work transforms the non-shadowed training instances into the shadowed counterparts for use as synthetic training samples, as opposed to the conventional method of correcting shadowed pixels to their non-shadowed counterparts. We propose learning this transformation model with unpaired data samples, which is particularly advantageous compared with the collection process of the same samples with and without shadow. Synthetic samples for shadow-obscured regions can be produced when this method is used, and these samples improve the model’s performance in classification tasks. Rigorously tested through a combination of qualitative and quantitative evaluations, the introduced data augmentation technique improves the performance of terrain classification models, especially with limited data samples.

© 2024 Society of Photo-Optical Instrumentation Engineers (SPIE)
Ali Gokalp Peker, Seniha Esen Yuksel, Ramazan Gokberk Cinbis, and Yasemin Yardimci Cetin "Shadow-aware terrain classification: advancing hyperspectral image sensing through generative adversarial networks and correlated sample synthesis," Journal of Applied Remote Sensing 18(3), 038506 (9 September 2024). https://doi.org/10.1117/1.JRS.18.038506
Received: 12 February 2024; Accepted: 12 August 2024; Published: 9 September 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Education and training

Data modeling

Shadows

Terrain classification

Hyperspectral imaging

Machine learning

Statistical modeling

Back to Top