A sparse coding multi-scale precise-timing machine learning algorithm for neuromorphic event-based sensors

Germain Haessig; Ryad Benosman

doi:10.1117/12.2305933

14 May 2018 A sparse coding multi-scale precise-timing machine learning algorithm for neuromorphic event-based sensors

Germain Haessig, Ryad Benosman

Proceedings Volume 10639, Micro- and Nanotechnology Sensors, Systems, and Applications X; 106391U (2018) https://doi.org/10.1117/12.2305933
Event: SPIE Defense + Security, 2018, Orlando, FL, United States

Abstract

This paper introduces an unsupervised compact architecture that can extract features and classify the contents of dynamic scenes from the temporal output of a neuromorphic asynchronous event-based camera. Event-based cameras are clock-less sensors where each pixel asynchronously reports intensity changes encoded in time at the microsecond precision. While this technology is gaining more attention, there is still a lack of methodology and understanding of their temporal properties. This paper introduces an unsupervised time-oriented event-based machine learning algorithm building on the concept of hierarchy of temporal descriptors called time surfaces. In this work we show that the use of sparse coding allows for a very compact yet efficient time-based machine learning that lowers both the computational cost and memory need. We show that we can represent visual scene temporal dynamics with a finite set of elementary time surfaces while providing similar recognition rates as an uncompressed version by storing the most representative time surfaces using clustering techniques. Experiments will illustrate the main optimizations and trade-offs to consider when implementing the method for online continuous vs. offline learning. We report results on the same previously published 36 class character recognition task and a 4 class canonical dynamic card pip task, achieving 100% accuracy on each.

Citation Download Citation

Germain Haessig and Ryad Benosman "A sparse coding multi-scale precise-timing machine learning algorithm for neuromorphic event-based sensors", Proc. SPIE 10639, Micro- and Nanotechnology Sensors, Systems, and Applications X, 106391U (14 May 2018); https://doi.org/10.1117/12.2305933

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available