Parallel hyperspectral image processing on distributed multicluster systems

Fangbin Liu; Frank J. Seinstra; Antonio J. Plaza

doi:10.1117/1.3595292

1 January 2011 Parallel hyperspectral image processing on distributed multicluster systems

Fangbin Liu, Frank J. Seinstra, Antonio J. Plaza

Author Affiliations +

Funded by: Netherlands Organization for Scientific Research (NWO), European Community's Marie Curie Research Training Networks Programme, Spanish Ministry of Science and Innovation, Spanish Ministry of Science and Innovation with the HYPERCOMP/EODIX

Journal of Applied Remote Sensing, Vol. 5, Issue 1, 051501 (January 2011). https://doi.org/10.1117/1.3595292

Abstract

Computationally efficient processing of hyperspectral image cubes can be greatly beneficial in many application domains, including environmental modeling, risk/hazard prevention and response, and defense/security. As individual cluster computers often cannot satisfy the computational demands of emerging problems in hyperspectral imaging, there is a growing need for distributed supercomputing using multicluster systems. A well-known manner of obtaining speedups in hyperspectral imaging is to apply data parallel approaches, in which commonly used data structures (e.g., the image cubes) are being scattered among the available compute nodes. Such approaches work well for individual compute clusters, but-due to the inherently large wide-area communication overheads-these are generally not applied in distributed multi-cluster systems. Given the nature of many algorithmic approaches in hyperspectral imaging, however, and due to the increasing availability of high-bandwidth optical networks, wide-area data parallel execution may well be a feasible acceleration approach. This paper discusses the wide-area data parallel execution of two realistic and state-of-the-art algorithms for endmember extraction in hyperspectral unmixing applications: automatic morphological endmember extraction and orthogonal subspace projection. It presents experimental results obtained on a real-world multicluster system, and provides a feasibility analysis of the applied parallelization approaches. The two parallel algorithms evaluated in this work had been developed before for single-cluster execution, and were not changed.Because no further implementation efforts were required, the proposed methodology is easy to apply to already available algorithms, thus reducing complexity and enhancing standardization.

©(2011) Society of Photo-Optical Instrumentation Engineers (SPIE)

Citation Download Citation

Fangbin Liu, Frank J. Seinstra, and Antonio J. Plaza "Parallel hyperspectral image processing on distributed multicluster systems," Journal of Applied Remote Sensing 5(1), 051501 (1 January 2011). https://doi.org/10.1117/1.3595292

Published: 1 January 2011

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE