This invention provides a display control apparatus capable of more quickly displaying the next image while suppressing a decrease in viewability. The apparatus displays an image together with an added non-image area when displaying, in a display area of a display unit to be used to display an image, the image having an aspect ratio different from that of the display area. Upon accepting a scroll operation of instructing scroll display of the image displayed in the display area, the apparatus performs the scroll display in accordance with the scroll operation. At this time, the apparatus adjusts the non-image area to decrease the width of the non-image area in the moving direction of the scroll during execution of the scroll display as the operation amount of the accepted scroll operation increases.