A composite operating device is provided having a small number of components to retain an operating member in a neutral position. A composite operating device includes an operating member that is operable to rotate and to slide a slider and a base. One of the base and the slider includes a flexible portion that is capable of elastic bending deformation relative to the other, the flexible portion including a first engagement portion. The other includes a second engagement portion that retains the slider in the neutral position by engaging with the first engagement portion. The second engagement portion presses against the first engagement portion while being displaced in the sliding direction relative to the first engagement portion to cause bending deformation of the flexible portion. The amount of deformation of the flexible portion increases with the amount of operation of the operating member in the sliding direction.