A circuit for improving accuracy of channel impulse response estimation and compensating for remnant frequency offset in a receiver of an orthogonal frequency division multiplexing (OFDM) system is provided. The circuit comprises an equalizer, for compensating a first signal for channel distortion with the channel impulse response estimate to generate a second signal. The circuit also comprises a remnant frequency compensation module, coupled to the equalizer, for rotating a phase of the second signal with a phase angle of an phase offset coefficient calculated according to a plurality of pilot signals of the second signal to generate a third signal. The circuit further comprises a error estimation module, coupled to the remnant frequency compensation module, for generating an error estimate according to the third signal and its hard decision estimate, and the error estimate is further fed back to the equalizer to refine the channel impulse response estimate.