A system for pothole detection comprises an input interface configured to receive sensor data and a pothole detector configured to determine a pothole based at least in part on the sensor data using a model, wherein the model is used to classify sensor data; and store pothole data associated with the pothole, wherein the pothole data comprises a pothole video.