An image processing apparatus is provided, which makes it possible to classify and store documents after scanning the documents by intuitive operations such as physically classifying the documents. The image processing apparatus according to the present invention includes an acquisition unit configured to acquire image data obtained by capturing an image of a document placed in an image capturing area; and a classification unit configured to classify the acquired image data according to at least one of a direction to which the document is framed-out from the image capturing area and a direction from which the document is framed-in to the image capturing area.