A combination of techniques for modifying sound provided to headphones to simulate a surround-sound speaker environment with listener adjustments. In one embodiment, Head Related Transfer Functions (HRTFs) are grouped into multiple groups, with four types of HRTF filters or other perceptual models being used and selectable by a user. Alternately, a custom filter or perceptual model can be generated from measurements of the user's body, such as optical or acoustic measurements of the user's head, shoulders and pinna. Also, the user can select a speaker type, as well as other adjustments, such as head size and amount of wall reflections.