Provided is a focal point adjustment control device, characterized by including: a focal point detection part for calculating an evaluation value relating to contrast of an image by an optical system and detecting the condition of focal point adjustment of the optical system; an acquisition part for acquiring from a lens barrel the maximum value and/or minimum value of an image plane motion coefficient indicating a correspondence relationship between the quantity of motion of a focal point adjustment lens included in the optical system and the quantity of motion of an image plane; and a controller employing the maximum value and/or the minimum value of the image plane motion coefficient, for determining a driving speed of the focal point adjustment lens during detection of the condition of focal point adjustment by the focal point detection part.