The invention provides a clock frequency adjusting method which includes the steps: calculating the phase difference between an SOF (start of frame) signal or an EOP (end of program) signal in an external signal and a local signal; counting counting values of the phase difference according to the clock frequency of a local oscillator; and adjusting the clock frequency according to the counting values. The invention further provides a clock frequency adjusting circuit.