A sheet conveying device includes a first conveying unit configured to convey a sheet in a conveying direction; a conveying path configured to guide the sheet to the first conveying unit, the sheet having been conveyed by the first conveying unit in a direction opposite to the conveying direction; a second conveying unit configured to convey the sheet in the conveying path; a rotation direction detecting unit configured to detect a rotation direction of the second conveying unit; and a control unit configured to perform control, at startup, to drive the first conveying unit in a direction that causes the sheet to be conveyed in the conveying direction, and if the rotation direction detecting unit detects rotation of the second conveying unit, to drive the second conveying unit in the rotation direction that is detected by the rotation direction detecting unit.