A system for autonomous driving comparison and evaluation comprises an input interface and a processor. The input interface is configured to receive trip information generated during a driver controlled trip and receive information from an autonomous driving system related to actions that the autonomous driving system would have taken had it been in control during the trip. The processor is configured to compare a trip factor of the driver controlled trip with a simulated trip factor that would have occurred had the autonomous driving system been in control.