An image decoding device includes: a motion vector decoding unit that decodes a motion vector from encoded data; a refinement unit that performs refinement processing to correct the decoded motion vector; and a predictive signal generation unit that generates a predictive signal on the basis of the corrected motion vector outputted from the refinement unit. The predictive signal generation unit determines whether or not to apply BDOF processing for each block, on the basis of information calculated in the course of the refinement processing.