The invention discloses an image processing apparatus and method thereof capable of preserving a great deal of light and dark details, so as to improve the contrast of each image. Furthermore, when calculating the value of gray level, the gray levels may be divided into equal parts, each of which includes four gray levels. Accordingly, the range of gray level is changed from 0˜255 to 0˜63, such that the hardware resources can be saved.