0
Special Section on Video Compression Technology

Enhanced low bitrate H.264 video coding using decoder-side super-resolution and frame interpolation

[+] Author Affiliations
Hasan F. Ates

Isik University, Department of Electrical and Electronics Engineering, Sile, Istanbul, Turkey

Opt. Eng. 52(7), 071505 (Mar 21, 2013). doi:10.1117/1.OE.52.7.071505
History: Received October 31, 2012; Revised February 15, 2013; Accepted February 26, 2013
Text Size: A A A

Abstract.  Advanced inter-prediction modes are introduced recently in literature to improve video coding performances of both H.264 and High Efficiency Video Coding standards. Decoder-side motion analysis and motion vector derivation are proposed to reduce coding costs of motion information. Here, we introduce enhanced skip and direct modes for H.264 coding using decoder-side super-resolution (SR) and frame interpolation. P- and B-frames are downsampled and H.264 encoded at lower resolution (LR). Then reconstructed LR frames are super-resolved using decoder-side motion estimation. Alternatively for B-frames, bidirectional true motion estimation is performed to synthesize a B-frame from its reference frames. For P-frames, bicubic interpolation of the LR frame is used as an alternative to SR reconstruction. A rate-distortion optimal mode selection algorithm is developed to decide for each MB which of the two reconstructions to use as skip/direct mode prediction. Simulations indicate an average of 1.04 dB peak signal-to-noise ratio (PSNR) improvement or 23.0% bitrate reduction at low bitrates when compared with H.264 standard. The PSNR gains reach as high as 3.00 dB for inter-predicted frames and 3.78 dB when only B-frames are considered. Decoded videos exhibit significantly better visual quality as well.

Figures in this Article
© 2013 Society of Photo-Optical Instrumentation Engineers

Citation

Hasan F. Ates
"Enhanced low bitrate H.264 video coding using decoder-side super-resolution and frame interpolation", Opt. Eng. 52(7), 071505 (Mar 21, 2013). ; http://dx.doi.org/10.1117/1.OE.52.7.071505


Access This Article
Sign In to Access Full Content
Please Wait... Processing your request... Please Wait.
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
 
Your Session has timed out. Please sign back in to continue.
Sign In to Access Full Content

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement

Buy this article ($18 for members, $25 for non-members).
Sign In