The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a high picture quality texture image of a predetermined viewpoint using an omnidirectional image. A reception section receives a texture image and a depth image as well as a guide image to be referred to upon generation of a display image in which the texture image and the depth image are used. A drawing section compares a pixel value of the display image generated using the texture image and the depth image and a corresponding pixel value of the guide image with each other and executes a process for changing the pixel value in response to a result of the comparison. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.