A hearing aid system for selective modification of background noises may include at least one processor. The processor may be programmed to receive a plurality of images from an environment of a user captured by a wearable camera during a time period and receive an audio signal representative of sounds acquired by a wearable microphone during the time period. The processor may determine that at least one of the sounds was generated by a sound-emanating object in the environment of the user, but outside of a field of view of the wearable camera and retrieve from a database information associated with the sound-emanating object. Based on the retrieved information, the processor may cause selective conditioning of audio signals acquired by the wearable microphone during the time period and cause transmission of the conditioned audio signals to a hearing interface device configured to provide sounds to an ear of the user.