A method and a system for adaptive image enhancement are provided for measuring the image quality of a pixel region in a frame, performing an image classification based on the image quality measurement, and enhancing image quality by applying operations according to image classification of the region. Also provided is a method as above including the steps of dividing a frame into P pixel regions; and for each one of the pixel regions measuring the image quality; assigning an image quality class; and enhancing the image. Also provided is a system for adaptive image enhancement including a circuit to measure the image quality of a pixel region in a frame in a source video image; a circuit to perform an image classification of the region based on the image quality measurement; and a circuit to enhance the image quality of the region in the source video image a by applying operations based on the image classification of the frame.