Teleoperation of a robot manipulator from 3D human hand-arm motion

Jonathan Kofman; Siddharth Verma; Xianghai Wu; Timothy Luu

doi:10.1117/12.515683

30 September 2003 Teleoperation of a robot manipulator from 3D human hand-arm motion

Jonathan Kofman, Siddharth Verma, Xianghai Wu, Timothy Luu

Proceedings Volume 5264, Optomechatronic Systems IV; (2003) https://doi.org/10.1117/12.515683
Event: Photonics Technologies for Robotics, Automation, and Manufacturing, 2003, Providence, RI, United States

Abstract

The control of a robot manipulator by a human operator is often necessary in unstructured dynamic environments with unfamiliar objects. Remote teleoperation is required when human presence at the robot site is undesirable or difficult, such as in handling hazardous materials and operating in dangerous or inaccessible environments. Previous approaches have employed mechanical or other contacting interfaces which require unnatural motions for object manipulation tasks or hinder dexterous human motion. This paper presents a non-contacting method of teleoperating a robot manipulator by having the human operator perform the 3D human hand-arm motion that would naturally be used to compete an object manipulation task and tracking the motion with a stereo-camera system at a local site. The 3D human hand-arm motion is reconstructed at the remote robot site and is used to control the position and orientation of the robot manipulator end-effector in real-time. Images captured of the robot interacting with objects at the remote site provide visual feedback to the human operator. Tests in teleoperation of the robot manipulator have demonstrated the ability of the human to carry out object manipulator tasks remotely and the teleoperated robot manipulator system to copy human-arm motions in real-time.

Citation Download Citation

Jonathan Kofman, Siddharth Verma, Xianghai Wu, and Timothy Luu "Teleoperation of a robot manipulator from 3D human hand-arm motion", Proc. SPIE 5264, Optomechatronic Systems IV, (30 September 2003); https://doi.org/10.1117/12.515683

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available