Voxel-based recovery and trajectory separable error rectification for multi-view 3D pose reconstruction of jump analysis in figure skating

Zisheng Zeng; Xina Cheng; Yanchao Liu; Takeshi Ikenaga

doi:10.1117/12.2669795

24 February 2023 Voxel-based recovery and trajectory separable error rectification for multi-view 3D pose reconstruction of jump analysis in figure skating

Zisheng Zeng, Xina Cheng, Yanchao Liu, Takeshi Ikenaga

Author Affiliations +

Proceedings Volume 12590, Third International Conference on Computer Vision and Information Technology (CVIT 2022); 125900C (2023) https://doi.org/10.1117/12.2669795
Event: 2022 3rd International Conference on Computer Vision and Information Technology (CVIT 2022), 2022, Beijing, China

Abstract

Successful jumps in figure skating with critical parameters such as proper jump height, spin speed, and the number of jump rotations, which are valuable for analysis in athlete training. Driven by recent computer vision applications, reconstructing 3D poses of the athlete in figure skating to extract the significant variables has become increasingly important. However, a large number of conventional works have obtained 3D poses from corresponding 2D information directly, which ignores the uniqueness of figure skating, such as self-occlusion, abnormal poses, etc. This paper proposes a multi-view voxel based system for calibration and error correction to reconstruct the 3D jumping poses of figure skaters in the presence of 2D heatmaps. The proposed method consists of two key components: Voxels based recovery method of high probability area in 2D heatmap; Plain 2D smoothness and motion trajectory and relative joint positions separable 3D smoothness based rectification method. This work is proven to be applicable to 3D pose dynamics in figure skating jumping motion. Mean Per Joint Position Error (MPJPE) is: 34.58mm in the pre-jump stage, 16.51mm in the jumping stage, 15.73mm in the post-jump stage, and 16.93mm in the whole jump stage, which is 36% improvement compared with the conventional work.

Citation Download Citation

Zisheng Zeng, Xina Cheng, Yanchao Liu, and Takeshi Ikenaga "Voxel-based recovery and trajectory separable error rectification for multi-view 3D pose reconstruction of jump analysis in figure skating", Proc. SPIE 12590, Third International Conference on Computer Vision and Information Technology (CVIT 2022), 125900C (24 February 2023); https://doi.org/10.1117/12.2669795

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Voxels

3D modeling

Cameras

3D image processing

Error analysis

Error control coding

Analytical research

Show All Keywords

Keywords/Phrases

Search In:

Publication Years