A golf ball pick-up device includes a body, which has a shape that allows the body to form a frame with a head of the golf club. The body has an end forming a clamping section that defines an internal receiving space. The clamping section also forms a sideway opening in communication with the receiving space. The clamping section uses the opening to lead a shaft of the golf club into the receiving space, so as to allow the clamping section to fit over and thus retain on the shaft of the golf club. A user may then use the frame formed by the body and the head of the golf club to pick up a golf ball, especially a ball that falls in a sand trap or a water hazard where hands may not reach to pick up the ball.