Low-power CNN for real-time driver posture monitoring by image processing

Gian Domenico Licciardo; Paola Vitolo; Rosalba Liguori; Luigi Di Benedetto; Andrea Donisi; Nicola Cappetti; Alessandro Naddeo

doi:10.1117/12.2665613

7 June 2023 Low-power CNN for real-time driver posture monitoring by image processing

Gian Domenico Licciardo, Paola Vitolo, Rosalba Liguori, Luigi Di Benedetto, Andrea Donisi, Nicola Cappetti, Alessandro Naddeo

Author Affiliations +

Proceedings Volume 12571, Real-time Processing of Image, Depth and Video Information 2023; 125710G (2023) https://doi.org/10.1117/12.2665613
Event: SPIE Optics + Optoelectronics, 2023, Prague, Czech Republic

Abstract

Driver posture and micro movements are main indicators of his attention and situation awareness, as well as of his capability to suddenly take control if necessary. Therefore, the real-time detection of wrong postures is essential to mitigate the risk of accidents. In this work we want to show that, by using a custom Convolutional Neural Network (CNN) for image processing, a very accurate driver posture recognition system can be realized by using a limited number of pressure sensors, grouped in a small carpet placed only on the seat of the driver, regardless of its shape. Data from the sensor carpet are converted in images reproducing the different pressure regions of the driver’s body, so that the CNN can extract features and classify 8 postures with an average accuracy of 98.81 % in real-time. According to the edge computing paradigm, the CNN implements an end-to-end classification by exploiting a quantization scheme for weights and binarized activations to reduce the number of required resources and allow a compact and low-power HW implementation on a small FPGA. When implemented with a Xilinx Artix 7 FPGA, the CNN consumes less than 7 mW of dynamic power at an operation frequency of 47.64 MHz. Such frequency is compatible with a sensor Output Data Rate (ODR) of 16.50 kHz, fundamental in critical applications, requiring a continuous monitoring and real-time action. Results of a 130 nm CMOS standard cells synthesis have also been reported.

Conference Presentation

Citation Download Citation

Gian Domenico Licciardo, Paola Vitolo, Rosalba Liguori, Luigi Di Benedetto, Andrea Donisi, Nicola Cappetti, and Alessandro Naddeo "Low-power CNN for real-time driver posture monitoring by image processing", Proc. SPIE 12571, Real-time Processing of Image, Depth and Video Information 2023, 125710G (7 June 2023); https://doi.org/10.1117/12.2665613

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available