An annotation system for providing annotations for original images is provided. In some embodiments, the annotation system accesses an annotation associated with an object of a 3D model. The annotation system also accesses and displays an original image. The annotation system renders a model image of the 3D model based on the view from which the original image was collected. When the model image contains the annotated object, the annotation system provides an indication that an annotation is associated with the object of the original image. The annotation system can provide indications of the annotation for other original images that include the annotated object irrespective of the view from which the other original images are collected.