A method is provided for encoding a digital video to provide for improved color mapping. The digital video has values in a first color space, and the method includes performing a color mapping operation on values in each sub-picture to convert the values in the first color space to values in a second, narrower, color space, wherein the color mapping operation is adapted based on the content of each sub-picture, encoding the values in the second color space into a base layer, performing a reverse color mapping operation on decoded values from the base layer in the second color space in each sub-picture to generate a reconstructed reference frame having values in the first color space, encoding values in the first color space into an enhancement layer based at least in part on the reconstructed reference frame, combining the base layer and the enhancement layer into a bitstream, sending the bitstream to a decoder, and sending one or more parameters to the decoder that describe the adaption of the reverse color mapping operation for at least some sub-pictures.