For selective local registration based on registration error, a method determines a first registration error between a template image and a source image. The method further warps the source image to compensate for camera motion in response to the first registration error exceeding a registration error threshold. In addition, the method determines a second registration error between the template image and the warped source image. The method generates a pixel difference mask using the template image. The method further selectively performs local registration for the source image based on the pixel difference mask in response to the second registration error exceeding the registration error threshold.