A method and apparatus for determining neighborhood video attribute values for a frame of video data are disclosed. In one aspect, the method includes receiving coordinates for a current block location and a previous block location of the frame and generating a vector indicative of the displacement of the current block from the previous block via comparing the coordinates of the current block location to the coordinates of the previous block location. The method may also include updating the neighborhood video attribute values based at least in part on the generated vector and processing the frame based on the updated neighborhood video attribute values.