An image sensor includes a plurality of pixels, each pixel belonging to one of N subframes each characterized by (a) a same exposure-time sequence that includes a short exposure-time alternating with a long exposure-time, and (b) a respective temporal offset equal to a multiple of the short exposure-time. A method for encoding a video stream captured by the image sensor includes (i) for each subframe, linearly combining a long-exposure image, captured at the long exposure-time, and a short-exposure image, captured at the short exposure-time, to yield a residual image, (ii) combining at least some of the long-exposure images from the N subframes to yield a full-frame image having a higher resolution than any long-exposure image, (iii) encoding the full-frame image into a base layer of the video stream, and (iv) encoding at least some of the residual images from the N subframes into an enhancement layer of the video stream.