Automatic facial animation parameters extraction in MPEG-4 visual communication

Chenggen Yang; Wanwei Gong; Lu Yu

doi:10.1117/12.453080

4 January 2002 Automatic facial animation parameters extraction in MPEG-4 visual communication

Chenggen Yang, Wanwei Gong, Lu Yu

Proceedings Volume 4671, Visual Communications and Image Processing 2002; (2002) https://doi.org/10.1117/12.453080
Event: Electronic Imaging, 2002, San Jose, California, United States

Abstract

Facial Animation Parameters (FAPs) are defined in MPEG-4 to animate a facial object. The algorithm proposed in this paper to extract these FAPs is applied to very low bit-rate video communication, in which the scene is composed of a head-and-shoulder object with complex background. This paper addresses the algorithm to automatically extract all FAPs needed to animate a generic facial model, estimate the 3D motion of head by points. The proposed algorithm extracts human facial region by color segmentation and intra-frame and inter-frame edge detection. Facial structure and edge distribution of facial feature such as vertical and horizontal gradient histograms are used to locate the facial feature region. Parabola and circle deformable templates are employed to fit facial feature and extract a part of FAPs. A special data structure is proposed to describe deformable templates to reduce time consumption for computing energy functions. Another part of FAPs, 3D rigid head motion vectors, are estimated by corresponding-points method. A 3D head wire-frame model provides facial semantic information for selection of proper corresponding points, which helps to increase accuracy of 3D rigid object motion estimation.

Citation Download Citation

Chenggen Yang, Wanwei Gong, and Lu Yu "Automatic facial animation parameters extraction in MPEG-4 visual communication", Proc. SPIE 4671, Visual Communications and Image Processing 2002, (4 January 2002); https://doi.org/10.1117/12.453080

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available