Provided is an image processing device including: a search unit that searches for an intra-prediction mode for each prediction block included in an image to be encoded; and a control unit that determines whether a chroma format is 4:2:2 and to limit a search range of intra-prediction modes of the search unit to a predetermined range in which no upper reference pixels are referred to with respect to a prediction block of chrominance components in a case where the chroma format is determined to be 4:2:2.