An apparatus and corresponding method for fast motion estimation with multiple reference pictures are provided, where an exemplary video encoder (100) for encoding video signal data for an image block relative to multiple reference pictures includes a fast motion estimator (180) for providing motion vectors corresponding to one of the reference pictures, including a scene detection portion for performing fast motion estimation while excluding reference pictures that fall across a scene change; and where a corresponding method (200) for encoding video signal data for an image block having multiple reference pictures includes receiving (210) a substantially uncompressed image block, detecting (215) a scene change, excluding (225) reference pictures that fall across the scene change, and computing (235) motion vectors corresponding to a difference between the image block and one of the plurality of reference pictures.