Rate Distortion Optimized Quantization

Question

Hi i am working on HEVC standard using HM Reference code Version 10.0. Basically i am planning to RD Optimized Quantization. Theoritically we need to Minimize the Cost Function J=D+Lambda*R. My question is How we have to Estimate R before Entropy Encoding for a Particular Frame. Also Which algorithm is used for RDOQ in HM code. Please provide me help as which are the functions that are doing RD Optimization in HM code. I am unable to follow the code flow. I will be happy if you provide me any links that explains code flow in HM Ref code. Thanks..

Answer 1

Too long to put in a comment...

First, why 10.0?

Anyway, search for the definition

#if ADAPTIVE_QP_SELECTION

in the code-base

Have a look at the function Void TComTrQuant::xRateDistOptQuant in file

source/Lib/TLibCommon/TComTrQuant.cpp

Hope it helps...