A paper sheet processing device includes: an input unit into which paper sheets are input from the outside; an identification unit for identifying the paper sheets fed out from the input unit while allowing them to pass through in a first direction and identifying the paper sheets while allowing them to pass through in a second direction opposite to the first direction; a temporary storage unit for temporarily storing the paper sheets identified as being acceptable by the identification unit; a payout unit for accommodating the paper sheets identified as being unacceptable by the identification unit so as to be able to be taken out to the outside; and a storage unit for storing the paper sheets fed out from the temporary storage unit and identified by the identification unit while being allowed to pass through the identification unit in the second direction, wherein the paper sheets fed out from the temporary storage unit and identified by the identification unit while being allowed to pass through the identification unit in the second direction can be transferred to the input unit.