Visual-based feeding intention recognition for feeding robots

Chenhao Yang; Donghui Zhao; Junyou Yang; Qianlong Wang; Ruoqian Wang

doi:10.1117/12.3030487

5 June 2024 Visual-based feeding intention recognition for feeding robots

Chenhao Yang, Donghui Zhao, Junyou Yang, Qianlong Wang, Ruoqian Wang

Proceedings Volume 13163, Fourth International Conference on Mechanical, Electronics, and Electrical and Automation Control (METMS 2024); 1316392 (2024) https://doi.org/10.1117/12.3030487
Event: International Conference on Mechanical, Electronics, and Electrical and Automation Control (METMS 2024), 2024, Xi'an, China

Abstract

With the arrival of population aging, the number of disabled people has increased, and existing populations with physical impairments. The dining problem is one of the most important problems they must solve. The feeding robot system has been introduced into the auxiliary nursing scene to reduce the burden of nursing staff. Multiple types of feeding robots have been developed. However most existing feeding robot systems still suffer from issues related to insufficient intelligence and convenience, with limited attention to user intention. To address this issue, we propose a vision-based algorithm for the interaction between the robot and users. This method effectively identifies user intentions for dining, menu selection, and chewing dynamics during meals. It enables the robot to operate more intelligently by the user’s intention without additional wearable devices, significantly enhancing user comfort and convenience. We conducted a series of experiments on dining intentions, selection menu intentions, and chewing dynamics during meals. The experimental results show that the average recognition rate of users’ dining intention is 98%, and the average recognition rate of chewing dynamics is 86.53%. This contribution presents an interactive approach for individuals without mobility, enhancing the intelligence of the feeding robot. It holds promise for future applications in nursing scenarios.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Chenhao Yang, Donghui Zhao, Junyou Yang, Qianlong Wang, and Ruoqian Wang "Visual-based feeding intention recognition for feeding robots", Proc. SPIE 13163, Fourth International Conference on Mechanical, Electronics, and Electrical and Automation Control (METMS 2024), 1316392 (5 June 2024); https://doi.org/10.1117/12.3030487

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Mouth

Robots

Cameras

Eye

Robotic systems

Visualization

Motion detection

Keywords/Phrases

Search In:

Publication Years