An electronic device may be coupled to an accessory such as a pair of earphones. The earphones may have ear presence sensor structures that determine whether or not the ears of a user are present in the vicinity of the earphones. The earphones may contain first and second speakers. When both the first and second speakers are located in the ears of the user, the electronic device may perform functions such as playing audio content. When one of the speakers has been removed from the ears of the user while the other of the speakers remains in the ears of the user, the electronic device can take actions such as pausing the playback of audio content, switching from stereo to monophonic playback, or stopping the playback of content. Suitable actions such as increasing audio drive strength may be taken when both speakers have been removed from the ears.