The invention discloses a brush holder and brush holder plate riveting device comprising an operating table. A positioning mechanism used for positioning a brush holder and a brush holder plate is disposed on the operating table. A left riveting cylinder and a right riveting cylinder are disposed on the operating table on two sides of the positioning mechanisms respectively. A left riveting die is arranged at the end of a piston rod of the left riveting cylinder. A right riveting die is arranged at the end of a piston of the right riveting cylinder. The left riveting die and the right riveting die are arranged on two opposite sides of the positioning mechanism. The left riveting cylinder and the right riveting cylinder are controlled via a same control circuit. A first intelligent inching switch and a second intelligent inching switch are serially connected to the control circuit. The first intelligent inching switch is disposed beside the left riveting cylinder; the second intelligent inching switch is disposed beside the right riveting cylinder. The invention aims to provide the brush holder and brush holder plate riveting device, which employs a two-cylinder riveting mode, is high in speed and efficiency, allows higher safety coefficient and protects workers from safety accidents caused by misoperation of riveting.