A vehicle monitoring device mounted on a vehicle includes an imaging unit for capturing images of a vehicle body side surface, a rear side and a diagonally backward of the vehicle, a storage unit that stores a reference image defining a reference state of the vehicle body side surface, and an image comparison unit that detects an abnormal state of the vehicle body by comparing the captured images captured by the imaging unit with the reference image read from the storage unit.