Multimodal recognition based on face and ear using local feature

Ruyin Yang; Zhichun Mu; Long Chen; Tingyu Fan

doi:10.1117/12.2280343

19 June 2017 Multimodal recognition based on face and ear using local feature

Ruyin Yang, Zhichun Mu, Long Chen, Tingyu Fan

Proceedings Volume 10443, Second International Workshop on Pattern Recognition; 104430K (2017) https://doi.org/10.1117/12.2280343
Event: Second International Workshop on Pattern Recognition, 2017, Singapore, Singapore

Abstract

The pose issue which may cause loss of useful information has always been a bottleneck in face and ear recognition. To address this problem, we propose a multimodal recognition approach based on face and ear using local feature, which is robust to large facial pose variations in the unconstrained scene. Deep learning method is used for facial pose estimation, and the method of a well-trained Faster R-CNN is used to detect and segment the region of face and ear. Then we propose a weighted region-based recognition method to deal with the local feature. The proposed method has achieved state-of-the-art recognition performance especially when the images are affected by pose variations and random occlusion in unconstrained scene.

Citation Download Citation

Ruyin Yang, Zhichun Mu, Long Chen, and Tingyu Fan "Multimodal recognition based on face and ear using local feature", Proc. SPIE 10443, Second International Workshop on Pattern Recognition, 104430K (19 June 2017); https://doi.org/10.1117/12.2280343

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available