Onboard ROI selection for aerial surveillance using a high resolution, high framerate camera

N. Boehrer; A. Gabriel; A. Brandt; W. Uijens; L. Kampmeijer; N. van der Stap; K. Schutte

doi:10.1117/12.2557988

21 April 2020 Onboard ROI selection for aerial surveillance using a high resolution, high framerate camera

N. Boehrer, A. Gabriel, A. Brandt, W. Uijens, L. Kampmeijer, N. van der Stap, K. Schutte

Proceedings Volume 11399, Mobile Multimedia/Image Processing, Security, and Applications 2020; 113990E (2020) https://doi.org/10.1117/12.2557988
Event: SPIE Defense + Commercial Sensing, 2020, Online Only

Abstract

With the latest advances in image sensor technology, cameras are able to generate video with tens of megapixels per frame. These high resolution videos streams offer great potential to be used in the surveillance domain. For ground based systems, gigapixel streams are already used with great effect as illustrated by the ICME 2019 crowd counting challenge. However, for Unmanned Aerial Vehicles (UAVs), this vast stream of data exceeds the limit of transmission bandwidth to send this data back to the ground. On board data analysis and selection is thus required to use and benefit from high resolution cameras. This paper presents a result of the CAVIAR project, where a combination of hardware and algorithms was designed to answer the question: ‘how to exploit a high resolution high frame rate camera on board a UAV?’. With the associated size, weight and power limitations, we implement data reduction by deploying deep learning on hardware to find the relevant information and transmit it to an operator station. The proposed solution aims at employing the high resolution potential of the sensor only onto objects of interest. We encode and transmit the identified regions containing those objects of interest (ROI) at the original resolution and framerate, while also transmitting the downscaled background to provide context for an operator. We demonstrate using a 35 fps, 65 Megapixel camera that this set-up indeed saves considerable bandwidth while retaining all important video data at high quality at the same time.

Conference Presentation

Citation Download Citation

N. Boehrer, A. Gabriel, A. Brandt, W. Uijens, L. Kampmeijer, N. van der Stap, and K. Schutte "Onboard ROI selection for aerial surveillance using a high resolution, high framerate camera", Proc. SPIE 11399, Mobile Multimedia/Image Processing, Security, and Applications 2020, 113990E (21 April 2020); https://doi.org/10.1117/12.2557988

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available