Scene understanding and task optimisation using multimodal imaging sensors and context: a real-time implementation

Barry Connor; Jonathan Letham; Neil Robertson; Iain Carrie

doi:10.1117/12.890207

20 May 2011 Scene understanding and task optimisation using multimodal imaging sensors and context: a real-time implementation

Barry Connor, Jonathan Letham, Neil Robertson, Iain Carrie

Author Affiliations +

Proceedings Volume 8012, Infrared Technology and Applications XXXVII; 80120A (2011) https://doi.org/10.1117/12.890207
Event: SPIE Defense, Security, and Sensing, 2011, Orlando, Florida, United States

Abstract

The aim of this paper is to describe the progress and results of an imaging system designed to optimise the performance of human operator tasks through exploitation of multimodal sensors and scene context. The performance of tasks such as surveillance, target detection and situational awareness is dependent on the scene content, the sensors available and the algorithms deployed. Intelligent analysis of the scene into contextual regions allows specific algorithms to be optimised and appropriate sensors to be selected, thereby increasing the performance of the operator's tasks. Context-specific algorithms, which will adapt as the scene changes, are required. In the case discussed in this paper, the contextual regions include road, sky and vegetation, and the dynamic detection of each region utilises different sensor modalities. The paper will describe the overall system concept and a real-time imaging demonstrator using GPUs, which will be used for future demonstrations of the context-specific processing. Simulations of the context-specific scene analysis will be described using sensor data from a vehicle in a rural environment. The performance of a motion detection system with and without context will also be illustrated using measured image data.

Citation Download Citation

Barry Connor, Jonathan Letham, Neil Robertson, and Iain Carrie "Scene understanding and task optimisation using multimodal imaging sensors and context: a real-time implementation", Proc. SPIE 8012, Infrared Technology and Applications XXXVII, 80120A (20 May 2011); https://doi.org/10.1117/12.890207

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available