A method of processing image data includes detecting a contour between an occlusion region and a non-occlusion region in a motion vector field of input video, generating a first contour and a second contour from the detected contour based on motion vectors of blocks corresponding to the detected contour, and separating the occlusion region into a first occlusion region adjacent to the first contour and a second occlusion region adjacent to the second contour. The method further includes reconstructing motion vectors of the first occlusion region based on motion vectors of the first contour and reconstructing motion vectors of the second occlusion region based on motion vectors of the second contour.