An image processing apparatus using a smart glass is provided, the image processing apparatus including an extractor to extract a first target to be observed by a user from a first image received from the smart glass and generate a second image using the extracted first target, an information collector to collect information related to the first target, and an image generator to reconstruct a third image using at least one of the second image and the information related to the first target, based on user settings.