An image decoding device includes: a prediction signal generation unit that generates a prediction signal by intra prediction, wherein in a block to which intra sub-partitions are applied, the prediction signal generation unit refers to a pixel of a decoded block adjacent to the block when generating prediction signals of all sub-blocks in the block.