The invention provides a camera self-calibration-based jittering video deblurring method and a camera self-calibration-based jittering video deblurring device. The method comprises the following steps: A, calculating the initial point diffuse function and deblurred image of a blurred image; B, performing self-calibration on the deblurred image to obtain the internal and external parameters of a camera; C, calculating a depth map according to the deblurred image and the internal and external parameters; D, estimating the intra-frame motion of the camera according to the initial point diffuse function and the depth map; E, optimizing intra-frame motion and the deblurred image according to a probability model to obtain the final intra-frame motion and the final deblurred image; and F, executing the steps from A to E circularly to obtain the deblurred video of a jittering video. In the method, depth-associated video image sequence deblurring is realized by a camera self-calibration technique, so the video image sequence has a better deblurring effect and the image deblurring efficiency is improved.