A video decoder may be configured to decode a first value representative of a difference between a base most significant bits (MSBs) value of a picture order count (POC) value of a current picture of video data and a first MSBs value of a first POC value of a first long-term reference picture of the video data, decode a second value representative of a difference between a second MSBs value of a second POC value of a second long-term reference picture of the video data and the first MSBs value, wherein the first POC value and the second POC value have different least significant bits values, and decode at least a portion of a current picture of the video data relative to at least one of the first long-term reference picture and the second long-term reference picture.