OE Letters

Audio extraction from silent high-speed video using an optical technique

[+] Author Affiliations
Zhaoyang Wang, Hieu Nguyen, Jason Quisberth

The Catholic University of America, Department of Mechanical Engineering, Washington, DC 20064, United States

Opt. Eng. 53(11), 110502 (Nov 21, 2014). doi:10.1117/1.OE.53.11.110502
History: Received September 19, 2014; Accepted October 29, 2014
Text Size: A A A

Abstract.  It is demonstrated that audio information can be extracted from silent high-speed video with a simple and fast optical technique. The basic principle is that the sound waves can stimulate objects encountered in the traveling path to vibrate. The vibrations, although usually with small amplitudes, can be detected by using an image matching process. The proposed technique applies a subset-based image correlation approach to detect the motions of points on the surface of an object. It employs the Gauss-Newton algorithm and a few other measures to achieve very fast and highly accurate image matching. Because the detected vibrations are directly related to the sound waves, a simple model is introduced to reconstruct the original audio information of the sound waves. The proposed technique is robust and easy to implement, and its effectiveness has been verified by experiments.

Figures in this Article
© 2014 Society of Photo-Optical Instrumentation Engineers

Topics

Video

Citation

Zhaoyang Wang ; Hieu Nguyen and Jason Quisberth
"Audio extraction from silent high-speed video using an optical technique", Opt. Eng. 53(11), 110502 (Nov 21, 2014). ; http://dx.doi.org/10.1117/1.OE.53.11.110502


Tables

Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.