Some embodiments provide a computer program for performing a color matching operation. The computer program identifies first and second images. Each image includes several pixels. Each pixel includes a luma component value. Based on analysis of the luma component values of the pixels of the first and second images, the computer program determines a set of transforms to modify pixel values of the first image so that the pixel values of the first image are similar to pixel values of the second image. The computer program applies the set of transforms to the first image such that the pixel values of the first image are similar to the pixel values of the second image.