Special Section on Video Compression Technology

Enhanced low bitrate H.264 video coding using decoder-side super-resolution and frame interpolation

[+] Author Affiliations
Hasan F. Ates

Isik University, Department of Electrical and Electronics Engineering, Sile, Istanbul, Turkey

Opt. Eng. 52(7), 071505 (Mar 21, 2013). doi:10.1117/1.OE.52.7.071505
History: Received October 31, 2012; Revised February 15, 2013; Accepted February 26, 2013
Text Size: A A A

Abstract.  Advanced inter-prediction modes are introduced recently in literature to improve video coding performances of both H.264 and High Efficiency Video Coding standards. Decoder-side motion analysis and motion vector derivation are proposed to reduce coding costs of motion information. Here, we introduce enhanced skip and direct modes for H.264 coding using decoder-side super-resolution (SR) and frame interpolation. P- and B-frames are downsampled and H.264 encoded at lower resolution (LR). Then reconstructed LR frames are super-resolved using decoder-side motion estimation. Alternatively for B-frames, bidirectional true motion estimation is performed to synthesize a B-frame from its reference frames. For P-frames, bicubic interpolation of the LR frame is used as an alternative to SR reconstruction. A rate-distortion optimal mode selection algorithm is developed to decide for each MB which of the two reconstructions to use as skip/direct mode prediction. Simulations indicate an average of 1.04 dB peak signal-to-noise ratio (PSNR) improvement or 23.0% bitrate reduction at low bitrates when compared with H.264 standard. The PSNR gains reach as high as 3.00 dB for inter-predicted frames and 3.78 dB when only B-frames are considered. Decoded videos exhibit significantly better visual quality as well.

Figures in this Article
© 2013 Society of Photo-Optical Instrumentation Engineers

Citation

Hasan F. Ates
"Enhanced low bitrate H.264 video coding using decoder-side super-resolution and frame interpolation", Opt. Eng. 52(7), 071505 (Mar 21, 2013). ; http://dx.doi.org/10.1117/1.OE.52.7.071505


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.