One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

Kevin Benham; Elihu Deneke

doi:10.1117/12.3034704

19 November 2024 One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

Kevin Benham, Elihu Deneke

Author Affiliations +

Proceedings Volume 13196, Artificial Intelligence and Image and Signal Processing for Remote Sensing XXX; 131960F (2024) https://doi.org/10.1117/12.3034704
Event: Remote Sensing, 2024, Edinburgh, United Kingdom

Abstract

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library which is often expanded with physics-models to incorporate different spectral characteristics. Generally, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML) based methods, is beholden to subjectivity in derived detection map quality. In this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared (LWIR) HSI obtained from historical Mako sensor campaigns over Los Angles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune & select PNNs to detect multiple gas targets which are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed for ML-based predictors, but less common on detection methods relying on learned latent spaces.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Kevin Benham and Elihu Deneke "One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery", Proc. SPIE 13196, Artificial Intelligence and Image and Signal Processing for Remote Sensing XXX, 131960F (19 November 2024); https://doi.org/10.1117/12.3034704

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available