The present disclosure provides systems and methods for applying a volume gain to change the playback volume of a device by calculating a smoothed noise estimate. The smoothed noise estimate may calculated using an exponential smoothing method. The exponential smoothing method may include applying a weight factor to both a background noise estimate and a historical smoothed noise estimate. The weight factor may place more emphasis on either the background noise estimate or the historical smoothed noise estimate depending on the value of the weight factor. The value of the weight factor may change based on the type of environment the device is in, the speed of the background noise transitions, and/or historical data. The calculated smoothed noise estimate may be used to calculate a volume gain. The volume gain may be applied over a period of time such that the playback volume of the device changes smoothly.