Disclosed is an image deformation processing device including: a shift amount calculating unit configured to calculate the difference between the coordinate of the input image which is mapped to the position of the specified pixel by the deformation process and the coordinate of the specified pixel as a shift amount, for each specified pixel in the output image; and an output unit configured to obtain the threshold corresponding to the coordinate of the specified pixel in the second direction from the dispersion threshold table, to calculate a pixel shift amount by comparing the obtained threshold with a decimal component of the shift amount for the specified pixel and by rounding the decimal component of the shift amount, and to output the pixel in the input image, which has a coordinate shifted from the coordinate of the specified pixel by the pixel shift amount, as the specified pixel.