Virtual mirror based on 3D-shape reconstruction and real-time face tracking

Takao Makino; Toshiya Nakaguchi; Norimichi Tsumura; Yoichi Miyake

doi:10.1117/12.585841

17 January 2005 Virtual mirror based on 3D-shape reconstruction and real-time face tracking

Takao Makino, Toshiya Nakaguchi, Norimichi Tsumura, Yoichi Miyake

Proceedings Volume 5670, Internet Imaging VI; (2005) https://doi.org/10.1117/12.585841
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

Human face gives various kinds of information such as feeling, age, physical condition and so on. Therefore it is important to acquire and reconstruct the facial pattern precisely for various kinds of applications. Our goal is to create the electronic cosmetics systems with real-time tracking of 3D facial pattern. A simple 3D virtual mirror interface system is proposed for acquisition and reconstruction of facial pattern, which enables a real time tracking of 3D facial pattern. The movement of lip in the face, which can be estimated based on mean shift and Kalman filter is introduced to recognize the rotation and parallel shift of face. Modified Photometric Stereo Method is also proposed to acquire the 3D shape without the influence of deficiency in shadow area of the object. It is shown that the proposed system is effective to acquire and reconstruct for the real-time tracking of 3D facial pattern image than traditional approaches. We consider that this interface can be applied to the electronic cosmetics systems that can simulate make-up, plastic surgery and color appearance under various illuminations.

Citation Download Citation

Takao Makino, Toshiya Nakaguchi, Norimichi Tsumura, and Yoichi Miyake "Virtual mirror based on 3D-shape reconstruction and real-time face tracking", Proc. SPIE 5670, Internet Imaging VI, (17 January 2005); https://doi.org/10.1117/12.585841

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available