An autonomous driving apparatus that automatically controls the steering and speed of a vehicle to cause the vehicle to travel includes: an abnormality detection part that detects at least one of an abnormality in a drive system of the vehicle and an abnormality in a sensor that detects surrounding situations when the steering and speed of the vehicle are automatically controlled; and an automatic control part that switches the automatic control of the speed to manual control in which the speed is controlled by a driver's operation if an abnormality has been detected by the abnormality detection part, and continues the automatic control of the steering until a predetermined waiting time has passed from the moment at which the automatic control of the speed was switched to the manual control.