PointIt3D: a benchmark dataset and baseline for pointed object detection task

Chunru Lin; Hongxin Zhang; Haotian Zheng

doi:10.1117/12.2645330

12 October 2022 PointIt3D: a benchmark dataset and baseline for pointed object detection task

Chunru Lin, Hongxin Zhang, Haotian Zheng

Proceedings Volume 12342, Fourteenth International Conference on Digital Image Processing (ICDIP 2022); 1234217 (2022) https://doi.org/10.1117/12.2645330
Event: Fourteenth International Conference on Digital Image Processing (ICDIP 2022), 2022, Wuhan, China

Abstract

Pointed object detection is of great importance for human-machine interaction, but attempts to solve this task may run into the difficulties of lack of available large scale datasets since people hardly record 3D scenes with a human pointing at specific objects. In efforts to mitigate this gap, we cultivate the first benchmark dataset for this task: PointIt3D (available at https://pan.baidu.com/share/init?surl=E3u96E7dEXnrR1dDris_1w (access code: jps5)), containing 347 scans now and can be easily scaled up to facilitate future utilizations, which is automatically constructed from existing 3D scenes from ScanNet1 and 3D people models using our novel synthetic algorithm that achieves a high acceptable rate of more than 85% according to three experts’ assessments, which hopefully would pave the way for further studies. We also provide a simple yet effective baseline based on anomaly detection and majority voting pointline generation to solve this task based on our dataset, which achieves accuracy of 55.33%, leaving much room for further improvements. Code will be released at https://github.com/XHRlyb/PointIt3D.

Citation Download Citation

Chunru Lin, Hongxin Zhang, and Haotian Zheng "PointIt3D: a benchmark dataset and baseline for pointed object detection task", Proc. SPIE 12342, Fourteenth International Conference on Digital Image Processing (ICDIP 2022), 1234217 (12 October 2022); https://doi.org/10.1117/12.2645330

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available