An image matching device includes a weight determination unit and a matching unit. Based on a synthesized frequency characteristic obtained by synthesizing a frequency characteristic of a first image with a frequency characteristic of a second image and an ideal synthesized frequency characteristic that is an ideal one obtained by synthesizing the frequency characteristic of the first image with the frequency characteristic of the second image, the weight determination unit determines a weight relating to frequency in performing matching of the first image and a third image. The matching unit performs matching of the first image and the third image based on the determined weight.