A tool with a segmented tool handle includes a first tube, a second tube and a limiting seat. The first tube has a first inner hole and a first fastening hole. The second tube has one end inserted into the first inner hole, a second inner hole and a second fastening hole. The limiting seat is disposed in the second inner hole and connected with a fastener. An end of the fastener is threadedly connected to the limiting seat and the other end of the fastener has a conical abutting portion. The abutting portion abuts against an inner periphery of first fastening hole when the fastener is in a fastened position. The abutting portion detaches from the first fastening hole when the fastener is in a unfastened position.