A power conversion device control system includes a power conversion device configured to supply electric power to a rotary electric machine, and a control device configured to control the power conversion device, wherein the control device controls the power conversion device through synchronous control in which a carrier frequency of the power conversion device is proportional to a rotational speed of the rotary electric machine when a temperature of a permanent magnet provided in the rotary electric machine is higher than a predetermined threshold value, and controls the power conversion device through non-synchronous control in which a carrier frequency of the power conversion device is not proportional to a rotational speed of the rotary electric machine when a temperature of the permanent magnet is the predetermined threshold value or less.