An autonomous vehicle includes an apparatus for determining a confidence level of perception data gathered from vehicle sensor subsystems, as well as determining a confidence level of a regional map. The system is also configured to determine an action of agents of interest in front of the autonomous vehicle. A method of controlling the autonomous vehicle utilizing the system includes altering the trajectory of the autonomous vehicle in response to the confidence level determined for the perception data and regional map.