Expandable SPAD-based real-time gun muzzle flash localization system using FPGAs and deep learning

Lih-Wei Chia; Mehul Motani

doi:10.1117/12.2668380

13 June 2023 Expandable SPAD-based real-time gun muzzle flash localization system using FPGAs and deep learning

Lih-Wei Chia, Mehul Motani

Proceedings Volume 12527, Pattern Recognition and Tracking XXXIV; 125270K (2023) https://doi.org/10.1117/12.2668380
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Abstract

Gun muzzle flash produces characteristic signatures on the 766nm and 769nm wavelengths that can be passively picked up from a distance using ultra-sensitive SPAD arrays for immediate localization. Sifting through the massive number of pulses generated by the arrays in real-time however poses a challenge, especially when deep-learning models are used for classification. We present a novel FPGA-based expandable system consisting of a two-tier detection architecture that decouples the computationally-intensive deep-learning model from the data rate intensive SPAD arrays. Our slope-based first tier algorithm provides an FPGA-efficient first-look filter and our ResNet-based deep-learning model provides high sensitivity across different lighting conditions while maintaining high specificity in the face of potential false positives in an urban environment. The deep-learning model was trained with synthetic datasets generated from small samples of gun muzzle flashes from various weapons and ammunition types available to us, and sources of likely false positives in an urban environment. In testing, our system achieves a detection rate of 99.8%, 99.9% specificity and 99.6% sensitivity for shots fired from distances between 50 to 450m.

Conference Presentation

Citation Download Citation

Lih-Wei Chia and Mehul Motani "Expandable SPAD-based real-time gun muzzle flash localization system using FPGAs and deep learning", Proc. SPIE 12527, Pattern Recognition and Tracking XXXIV, 125270K (13 June 2023); https://doi.org/10.1117/12.2668380

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available