Methods and apparatus for coding video information having a plurality of video samples are disclosed. Blocks for video data are coded by an encoder based upon a quantization parameter (QP) for each block. The QP used for each block may be limited by a maximum QP value. A buffer fullness of a buffer unit may be determined that indicates of a ratio between a number of bits currently occupied in the buffer unit and a current capacity of the buffer unit. The encoder may determine an adjustment value for the maximum QP based upon the determined buffer fullness. By dynamically adjusting the maximum QP for coding blocks of video data, distortion from quantization may be reduced while preventing the buffer unit from overflowing or emptying.