An intermittent drive device includes a tooth-missing gear having a tooth row partially missing, an output gear, an input gear provided with a first tooth row receiving a driving force and a second tooth row transmitting the driving force to the tooth-missing gear and arranged at a position apart from the output gear in a rotation axis direction. A shaft joint member moves in the rotation axis direction to a first position where the driving force is transmitted to the output gear and a second position where the transmission is released. A tooth-missing gear control mechanism starts rotation of the tooth-missing gear from a state where the driving force from the input gear is released and meshes with the input gear. A switching mechanism switches a position of the shaft joint member in the rotation axis direction between the first position and the second position.