An auto-focus controlling apparatus includes a focus evaluation value generating device generating a focus evaluation value based on image data acquired through the focus lens, a target lens position determining device determining a target lens position, a timing determining device determining a plurality of acquisition lens positions for acquiring the focus evaluation values in a scanning direction from a present lens position of the focus lens toward the target lens position, a scanning device driving the focus lens in the scanning direction, a predicted focus lens position determining device predicting a predicted focus lens position based on the acquired focus evaluation values and a moving device stopping the scanning device to drive the focus lens when the predicted focus lens position is determined and driving the focus lens in the same direction as the scanning direction to move the focus lens to the predicted focus lens position.