A method of performing image processing includes storing a reference picture into a frame buffer starting at a first starting address; overwriting at least a subset of the reference picture by storing at least a portion of a current picture into the frame buffer starting at a second starting address; protecting a plurality of blocks of the reference picture from being lost while storing each block of the current picture in the frame buffer; and performing a motion compensation procedure for a particular block of the current picture in the plurality of blocks of the reference picture that are being protected.