A method for processing an audio signal at an audio decoder, the method including receiving a downmix signal, a residual signal, and object information; extracting a background-object signal and a foreground-object signal from the downmix signal using the residual signal and object information; receiving mix information including gain information for the background-object signal; generating a downmix processing information based on the object information and the mix information; and generating an output signal including a modified background-object signal and a modified foreground-object signal. The modified background-object signal is obtained by modifying a gain of the background-object signal using the mix information. The modified foreground-object signal is obtained by modifying a gain of the foreground-object signal using the downmix processing information.