Techniques for efficient coding of video content are presented. When encoding motion vectors of a current block of a current video frame, a coder management component analyzes encoded blocks of the current frame adjacent to the current block and encoded blocks of the previous video frame that occupy locations in the previous frame corresponding to the locations of the current block and blocks adjacent to the current block. The coder management component arranges motion vectors in order as a function of spatial proximity, temporal distance between the previous frame and the current frame, and/or motion vector magnitude. The coder management component selects a coding mode, based on the order, to transmit to the decoder. A coder component encodes the current block using the motion vector associated with the coding mode.