A video image encoding device includes a calculation unit for calculating a decoding time of each group including plural blocks; a source encode unit for encoding each of the plural blocks based on the encoding amount of each block controlled based on the decoding time and generating compressed data; and an entropy encode unit for performing an arithmetic encoding process on the compressed data in each block and outputting a bit stream. The entropy encode unit outputs undetermined bits retained by the arithmetic encoding process when all bits corresponding to the compressed data in each group are not output at a time point when the arithmetic encoding process on the compressed data in a predetermined number of blocks in a next group is finished, and the calculation unit shifts the decoding time of each group by a processing time of the predetermined number of blocks.