Action detection system for alerting drivers using computer vision

Chia Hong Khoo; Phooi Yee Lau

doi:10.1117/12.2625232

30 April 2022 Action detection system for alerting drivers using computer vision

Chia Hong Khoo, Phooi Yee Lau

Proceedings Volume 12177, International Workshop on Advanced Imaging Technology (IWAIT) 2022; 121770K (2022) https://doi.org/10.1117/12.2625232
Event: International Workshop on Advanced Imaging Technology 2022 (IWAIT 2022), 2022, Hong Kong, China

Abstract

Nowadays, the increasing number of careless drivers on the road has resulted in more accident cases. Driver’s decisions and behaviors are the key to maintain road safety. However, many drivers tend to do secondary tasks like playing with their phone, adjusting radio player, eating or drinking, answering phone calls, and worse case is reading phone texts. In previous efforts, many kinds of approaches had been introduced to try to solve the task to recognize and capture potential problem related to careless driving inside the car. In this project, the work will mainly focus on the driver's secondary task recognition using the action detection method. A camera will be set up inside the car for the real-time extract of driver’s action. The video will undergo a process to extract out the human pose frames without background, called human pose estimator framework. Inside this framework, raw images will be input into a convolutional neural network (CNN) that computes human key-point's activation maps. After, that key-point's coordinate will be computed using the output activation maps and drawn on a new blank frame. Then the frames will be input into classification CNN network for the action classification. If an action performed by driver is considered a dangerous secondary task, alert will be given. The proposed framework was able to achieve a higher speed compared to other people's framework if it is being run on Raspberry Pi CPU. It is able to detect 10 different driver actions where only talking to passengers and normal driving will not trigger the buzzer to give alert to driver.

Citation Download Citation

Chia Hong Khoo and Phooi Yee Lau "Action detection system for alerting drivers using computer vision", Proc. SPIE 12177, International Workshop on Advanced Imaging Technology (IWAIT) 2022, 121770K (30 April 2022); https://doi.org/10.1117/12.2625232

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Convolution

Computer vision technology

Computing systems

Machine vision

Roads

Classification systems

Image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years