A model-assisted annotating system is operable to receive a first set of annotation data for a first set of medical scans from a set of client devices. A computer vision model is trained by utilizing first set of medical scans and the first set of annotation data. A second set of annotation data for a second set of medical scans is generated by utilizing the computer vision model. The second set of medical scans and the second set of annotation data is transmitted to the set of client devices, and a set of additional annotation data is received in response. An updated computer vision model is generated by utilizing the set of additional annotation data. A third set of annotation data is generated for a third set of medical scans by utilizing the updated computer vision model for transmission to the set of client devices for display.