The invention discloses a contact assembly of a high voltage isolating switch and a female contact thereof. The contact assembly comprises a female contact and a male contact, wherein the female contact comprises a first conductive arm, a conical ring, a positioning ring and multiple contact fingers; the front end of the first conductive arm forms a conical section, and the outer diameter of the conical section is converging-shaped from the rear end to the front end; the conical ring forms a mounting hole with the angle matched with the conical section; the positioning ring is arranged at the joint place between the conductive arm and the conical section; the multiple contact fingers are uniformly distributed on the outer surface of the conical section along a circumference, and the rear ends of the multiple contact fingers are limited by the positioning ring; and the conical ring sleeves the periphery of the multiple contact fingers through the mounting hole, and the multiple contact fingers are squeezed in a gap formed with the conical section. The contact assembly has a small size, multiple contacts are provided, the operation requirements of the high-current isolation switch can be met, and the problem that the contact is heated can be effectively solved.