Speech recognition technology combined with three-dimensional lip movement

Kazumi Komiya; Ryo Ishikawa; Keiko Momose

doi:10.1117/12.424893

13 April 2001 Speech recognition technology combined with three-dimensional lip movement

Kazumi Komiya, Ryo Ishikawa, Keiko Momose

Author Affiliations +

Proceedings Volume 4298, Three-Dimensional Image Capture and Applications IV; (2001) https://doi.org/10.1117/12.424893
Event: Photonics West 2001 - Electronic Imaging, 2001, San Jose, CA, United States

Abstract

In order to improve speech recognition efficiency under background noise such as out of doors, we propose a new recognition technology combined with three dimensional lip movements. In this paper firstly, three-dimensional movements at four positions of the mouth were measured using principal component analysis to clarify which positions and which directions are main contributors to pronunciation. Secondly, recognition evaluation tests for 50 Japanese words were carried out under noise levels ranging from 40 to 80 dB. In the experiment, over 80% of recognition efficiency was measured at 70dB and improvement of 40% was obtained compared with ordinary speech recognition. From the experimental results, the proposed method can be modified to be used as practical speech recognition technology. Finally, research subjects were picked up such as an improvement in precision of measuring lip movement and experiments and data collection out of doors.

Citation Download Citation

Kazumi Komiya, Ryo Ishikawa, and Keiko Momose "Speech recognition technology combined with three-dimensional lip movement", Proc. SPIE 4298, Three-Dimensional Image Capture and Applications IV, (13 April 2001); https://doi.org/10.1117/12.424893

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE