A model-based scan line encoder is disclosed. A method of model-based scan line encoding includes defining a geometry model for describing a scan line of a scan, the scan line including multiple scan points. The method further includes calculating a trajectory model representing an approximate pattern of deviation of the multiple scan points relative to the geometry model. The method further includes calculating multiple residuals, each of the residuals associated with a difference between the deviation of the scan points and the trajectory model. The method may further include compressing the residuals.