Imaging systems may be provided with image sensors for capturing images. An image sensor may include storage and processing circuitry having a conformal image buffer to be used in performing various types of image transformations on captured input images. The storage and processing circuitry may perform the image transformations, in part, by storing a portion of a captured input image in the conformal image buffer. A conformal image buffer may include a buffer for storing input image pixel values specific to various types of image transformations and memory for storing a pixel buffer lookup table. The pixel buffer lookup table may be used by the storage and processing circuitry to determine which input image pixel values should be stored in the conformal image buffer for each type of image transformation and to provide random read access to the stored input image pixel values in the conformal image buffer.