A virtual visor system is disclosed that includes a visor having a plurality of independently operable pixels that are selectively operated with a variable opacity. A camera captures images of the face of a driver or other passenger and, based on the captured images, a controller operates the visor to automatically and selectively darken a limited portion thereof to block the sun or other illumination source from striking the eyes of the driver, while leaving the remainder of the visor transparent. The virtual visor system advantageously limits the rate of change of the opacity of each pixel of the visor while updating the optical state of the visor. In this way, rapid and distracting changes in the optical state of the visor are avoided, thereby improving the safety of the vehicle.