Disclosed herein are a system and a method for controlling rear vision is used for controlling a rear vision assembly (RVA) of a vehicle, the system comprising a sender, receivers, an orientation device, a controller, and a motor. At least one said receiver disposed at the RVA may receive a reference signal from the sender to generate a relative positioning signal. The orientation device, disposed at the RVA, senses the orientation thereof in the three-dimensional space. Based on the relative positioning signal, the controller determines a relative position of the RVA and the sender and compares it with a default relative position, in addition to comparing the sensed orientation with a default orientation, thus generating a driving signal that directs the motor to restore the RVA to its default configuration when the determined relative position has deviated from the default for a predefined time and the sensed orientation deviates from the default. The system and method for controlling the rear vision can memorize default rear vision configuration, and can automatically respond when judging that the rear vision is deflected.