A method of processing an audio signal is provided. The method includes acquiring location information and performance information of a speaker configured to output an audio signal, selecting a frequency band based on the location information, determining a section to be strengthened from the selected frequency band with respect to the audio signal based on the performance information, and applying a gain value to the determined section.