Dataset creation pipeline for camera-based heart rate estimation

Mohamed Moustafa; Amr Elrasad; Joseph Lemley; Peter Corcoran

doi:10.1117/12.2679919

7 June 2023 Dataset creation pipeline for camera-based heart rate estimation

Mohamed Moustafa, Amr Elrasad, Joseph Lemley, Peter Corcoran

Proceedings Volume 12701, Fifteenth International Conference on Machine Vision (ICMV 2022); 127011V (2023) https://doi.org/10.1117/12.2679919
Event: Fifteenth International Conference on Machine Vision (ICMV 2022), 2022, Rome, Italy

Abstract

Heart rate is one of the most vital health metrics which can be utilized to investigate and gain intuitions into various human physiological and psychological information. Estimating heart rate without the constraints of contact-based sensors thus presents itself as a very attractive field of research as it enables well-being monitoring in a wider variety of scenarios. Consequently, various techniques for camera-based heart rate estimation have been developed ranging from classical image processing to convoluted deep learning models and architectures. At the heart of such research efforts lies health and visual data acquisition, cleaning, transformation, and annotation. In this paper, we discuss how to prepare data for the task of developing or testing an algorithm or machine learning model for heart rate estimation from images of facial regions. The data prepared is to include camera frames as well as sensor readings from an electrocardiograph sensor. The proposed pipeline is divided into four main steps, namely removal of faulty data, frame and electrocardiograph timestamp de-jittering, signal denoising and filtering, and frame annotation creation. Our main contributions are a novel technique of eliminating jitter from health sensor and camera timestamps and a method to accurately time align both visual frame and electrocardiogram sensor data which is also applicable to other sensor types.

Citation Download Citation

Mohamed Moustafa, Amr Elrasad, Joseph Lemley, and Peter Corcoran "Dataset creation pipeline for camera-based heart rate estimation", Proc. SPIE 12701, Fifteenth International Conference on Machine Vision (ICMV 2022), 127011V (7 June 2023); https://doi.org/10.1117/12.2679919

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available