A method and apparatus of image coding including a no-residue prediction mode are disclosed. At the encoder side, current predictors for a current coding unit are determined according to a target prediction process associated with a target prediction mode. The current predictors are determined based on pixel data including reconstructed pixels in the current slice or the current image. The target prediction process is applied to the current coding unit using the current predictors to generate prediction residues. A distortion condition or a cost measure for the prediction residues is determined. If the distortion condition is satisfied or the cost measure favors coding without the prediction residues, the current coding unit is encoded into current compressed bits of the current coding unit without compressed data associated with the prediction residues. A corresponding decoding method and apparatus are also disclosed.