In implementations of object-based color adjustment, an image editing system adjusts hue and saturation of a digital image so that objects in the digital image do not appear unnatural. The image editing system quantizes a CIELAB color space into classes that represent pairs of a and b channel values. The image editing system determines probabilities that pixels of a digital image belong to each of the classes, and based on the probabilities, determines a range of hue and a range of saturation for each pixel. An object detector segments objects in the digital image to determine ranges of hue and saturation for each segmented object. The image editing system selectively adjusts the hue and saturation for objects of the digital image based on whether the hue and saturation range for the object include a value of hue and saturation, respectively, selected in a user interface.