An investigation of image fusion algorithms using a visual performance-based image evaluation methodology

Kelly E. Neriani; Alan R. Pinkus; David W. Dommett

doi:10.1117/12.779752

6 May 2008 An investigation of image fusion algorithms using a visual performance-based image evaluation methodology

Kelly E. Neriani, Alan R. Pinkus, David W. Dommett

Proceedings Volume 6968, Signal Processing, Sensor Fusion, and Target Recognition XVII; 696819 (2008) https://doi.org/10.1117/12.779752
Event: SPIE Defense and Security Symposium, 2008, Orlando, Florida, United States

Abstract

It is believed that the fusion of multiple different images into a single image should be of great benefit to Warfighters engaged in a search task. As such, more research has focused on the improvement of algorithms designed for image fusion. Many different fusion algorithms have already been developed; however, the majority of these algorithms have not been assessed in terms of their visual performance-enhancing effects using militarily relevant scenarios. The goal of this research is to apply a visual performance-based assessment methodology to assess four algorithms that are specifically designed for fusion of multispectral digital images. The image fusion algorithms used in this study included a Principle Component Analysis (PCA) based algorithm, a Shift-invariant Wavelet transform algorithm, a Contrast-based algorithm, and the standard method of fusion, pixel averaging. The methodology used has been developed to acquire objective human visual performance data as a means of evaluating the image fusion algorithms. Standard objective performance metrics, such as response time and error rate, were used to compare the fused images versus two baseline conditions comprising each individual image used in the fused test images (an image from a visible sensor and a thermal sensor). Observers completed a visual search task using a spatial-forced-choice paradigm. Observers searched images for a target (a military vehicle) hidden among foliage and then indicated in which quadrant of the screen the target was located. Response time and percent correct were measured for each observer. Results of this study and future directions are discussed.

Citation Download Citation

Kelly E. Neriani, Alan R. Pinkus, and David W. Dommett "An investigation of image fusion algorithms using a visual performance-based image evaluation methodology", Proc. SPIE 6968, Signal Processing, Sensor Fusion, and Target Recognition XVII, 696819 (6 May 2008); https://doi.org/10.1117/12.779752

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available