A system and method for using human driving patterns to manage speed control for autonomous vehicles are disclosed. A particular embodiment includes: generating data corresponding to desired human driving behaviors; training a human driving model module using a reinforcement learning process and the desired human driving behaviors; receiving a proposed vehicle speed control command; determining if the proposed vehicle speed control command conforms to the desired human driving behaviors by use of the human driving model module; and validating or modifying the proposed vehicle speed control command based on the determination.