Fast transform type selection using conditional Laplace distribution based rate estimation

Bohan Li; Jingning Han; Yaowu Xu

doi:10.1117/12.2568930

21 August 2020 Fast transform type selection using conditional Laplace distribution based rate estimation

Bohan Li, Jingning Han, Yaowu Xu

Proceedings Volume 11510, Applications of Digital Image Processing XLIII; 115101Z (2020) https://doi.org/10.1117/12.2568930
Event: SPIE Optical Engineering + Applications, 2020, Online Only

Abstract

Selecting among multiple transform kernels to code prediction residuals is widely used for better compression efficiency. Conventionally, the encoder performs trials of each transform to estimate the rate-distortion (R-D) cost. However, such an exhaustive approach suffers from a significant increase of complexity. In this paper, a novel rate estimation approach is proposed to by-pass the entropy coding process for each transform type using the conditional Laplace distribution model. The proposed method estimates the Laplace distribution parameter by the context inferred by the quantization level and finds the expected rate of the coefficients for transform type selection. Furthermore, a greedy search algorithm for separable transforms is also presented to further accelerate the process. Experimental results show that the transform type selection scheme using the proposed rate estimation method achieves high accuracy and provides a satisfactory speed-performance trade-off.

Conference Presentation

Citation Download Citation

Bohan Li, Jingning Han, and Yaowu Xu "Fast transform type selection using conditional Laplace distribution based rate estimation", Proc. SPIE 11510, Applications of Digital Image Processing XLIII, 115101Z (21 August 2020); https://doi.org/10.1117/12.2568930

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available