An example device for processing video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to determine whether an access unit of the video data includes a temporal motion constrained tile sets (MCTS) supplemental enhancement information (SEI) message; and decode an MCTS extraction information set (MCTS-EIS) SEI message of the access unit only when the access unit includes the temporal MCTS SEI message.