Support vector machine-based facial-expression recognition method combining shape and appearance

Eun Jung Han; Byung Jun Kang; Kang Ryoung Park; Sangyoun Lee

doi:10.1117/1.3506200

1 November 2010 Support vector machine-based facial-expression recognition method combining shape and appearance

Eun Jung Han, Byung Jun Kang, Kang Ryoung Park, Sangyoun Lee

Author Affiliations +

Optical Engineering, Vol. 49, Issue 11, 117202 (November 2010). https://doi.org/10.1117/1.3506200

Abstract

Facial expression recognition can be widely used for various applications, such as emotion-based human-machine interaction, intelligent robot interfaces, face recognition robust to expression variation, etc. Previous studies have been classified as either shape- or appearance-based recognition. The shape-based method has the disadvantage that the individual variance of facial feature points exists irrespective of similar expressions, which can cause a reduction of the recognition accuracy. The appearance-based method has a limitation in that the textural information of the face is very sensitive to variations in illumination. To overcome these problems, a new facial-expression recognition method is proposed, which combines both shape and appearance information, based on the support vector machine (SVM). This research is novel in the following three ways as compared to previous works. First, the facial feature points are automatically detected by using an active appearance model. From these, the shape-based recognition is performed by using the ratios between the facial feature points based on the facial-action coding system. Second, the SVM, which is trained to recognize the same and different expression classes, is proposed to combine two matching scores obtained from the shape- and appearance-based recognitions. Finally, a single SVM is trained to discriminate four different expressions, such as neutral, a smile, anger, and a scream. By determining the expression of the input facial image whose SVM output is at a minimum, the accuracy of the expression recognition is much enhanced. The experimental results showed that the recognition accuracy of the proposed method was better than previous researches and other fusion methods.

©(2010) Society of Photo-Optical Instrumentation Engineers (SPIE)

Citation Download Citation

Eun Jung Han, Byung Jun Kang, Kang Ryoung Park, and Sangyoun Lee "Support vector machine-based facial-expression recognition method combining shape and appearance," Optical Engineering 49(11), 117202 (1 November 2010). https://doi.org/10.1117/1.3506200

Published: 1 November 2010

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available