Example implementations described herein are directed to depression detection on roadways (e.g., potholes, horizontal panel lines of a roadway, etc.) through using vision sensor to realize improved safety for advanced driver assistance systems (ADAS) and autonomous driving (AD). Example implementations described herein detect candidate depressions in the roadway in real time and adjust the control of the vehicle system according to the detected depressions.