A modeling system trains computer models for an autonomous control system using computer simulated models of objects. The objects may be vehicles, and the computer simulated models may be virtual models of vehicles simulated by computer software. Since the vehicle models are computer simulated, various characteristics of the vehicle can be easily obtained by the modeling system. The various types of data may include geometric information of the vehicle, views of the vehicle from different perspectives, and the like. The modeling system can easily generate and label a large amount of training data using the characteristics of the computer simulated vehicles. The modeling system can use the training data to train computer models for the autonomous control system.