-
公开(公告)号:US12300261B1
公开(公告)日:2025-05-13
申请号:US17708618
申请日:2022-03-30
Applicant: Amazon Technologies, Inc.
Inventor: Yuzhou Liu , Ali Abdollahzadeh Milani , Tarun Pruthi , Trausti Thor Kristjansson
IPC: G10L21/02 , G10K11/175 , G10L21/0232 , G10L21/028 , G10L25/30 , H04R1/40 , H04R3/00 , G10L21/0216
Abstract: A system configured to perform neural sidelobe cancelling to achieve enhanced target speech separation. A device improves target speech separation by combining a fixed directional beamformer with a deep neural network (DNN) configured to (i) selectively enhance speech in one target direction, (ii) cancel speech from non-target directions, and (iii) cancel non-speech interference from all directions. By combining the directional output from the beamformer with raw microphone signals as input signals to the DNN, the DNN is given a directional cue with which to select the target speech. The DNN generates mask data representing the target speech using a combination of temporal convolutional blocks and causal self-attention blocks. For example, the DNN achieves low latency by processing a large number of short frames, while the causal self-attention blocks smooth the output and reinforce local consistency of speech.
-
公开(公告)号:US11172285B1
公开(公告)日:2021-11-09
申请号:US16707967
申请日:2019-12-09
Applicant: Amazon Technologies, Inc.
Inventor: Ke Li , Alex Kanaris , Ludger Solbach , Carlo Murgia , Kuan-Chieh Yen , Tarun Pruthi
Abstract: This disclosure describes, in part, techniques to process audio signals to lessen the impact that wind and/or other environmental noise has upon the resulting quality of these audio signals. For example, the techniques may determine a level of wind and/or other noise in an environment and may determine how best to process the signals to lessen the impact of the noise, such that one or more users that hear audio based on output of the signals hear higher-quality audio.
-
公开(公告)号:US11982737B1
公开(公告)日:2024-05-14
申请号:US17363302
申请日:2021-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Yuzhou Liu , Krishna Kamath Koteshwara , Rui Wang , Harsha Inna Kedage Rao , Tarun Pruthi , Trausti Thor Kristjansson
Abstract: Techniques for presence-detection devices to vary presence-detection sensitivity to detect different types of movements by objects, such as major movements and minor movements, using ultrasonic signals. The devices detect movement of a person in an environment by emitting ultrasonic signals into the environment, and characterizing the change in the frequency, or the Doppler shift, of the reflections of the ultrasonic signals off the person caused by the movement of the person relative to the presence-detection devices. The presence-detection devices may control the presence-detection sensitivity in order to detect major movements, such as a user walking in a room, as well as objects minor movements, such as a user typing at a computer. By adjusting the presence-detection sensitivity, the devices are able to improve the overall accuracy of detecting the presence of users in an environment.
-
公开(公告)号:US11614529B1
公开(公告)日:2023-03-28
申请号:US17206456
申请日:2021-03-19
Applicant: Amazon Technologies, Inc.
Inventor: Harsha Inna Kedage Rao , Maziyar Khorasani , Tarun Pruthi , Krishna Kamath Koteshwara
Abstract: Techniques for presence-detection devices to emission levels of ultrasonic signals that are used to detect movement in an environment. The presence-detection devices may detect movement of a person by emitting the ultrasonic signals into an environment, and characterizing the change in the frequency, or the Doppler shift, of the reflections of the ultrasonic signals off the person caused by the movement of the person relative to the presence-detection devices. However, presence-detection devices that continuously emit ultrasonic signals may experience reduced battery life, increased likelihood of overheating, etc. To reduce these negative effects, the presence-detection devices may reduce the emission levels of ultrasonic signals. For instance, once motion is detected, the presence-detection devices may, for a period of time, stop emitting ultrasonic signals or reduce the power level at which the ultrasonic signals are emitted. Accordingly, the presence-detection devices can reduce emission levels of ultrasonic signals while still detecting motion.
-
公开(公告)号:US11564036B1
公开(公告)日:2023-01-24
申请号:US17076584
申请日:2020-10-21
Applicant: Amazon Technologies, Inc.
Inventor: Krishna Kamath Koteshwara , Zhen Sun , Spencer Russell , Tarun Pruthi , Yuzhou Liu , Wan-Chieh Pai
IPC: H04R3/04 , H04R5/04 , G10L21/0232 , G01S15/04 , H04R5/027 , G10L21/0208
Abstract: Techniques for presence-detection devices to detect movement of a person in an environment by emitting ultrasonic signals using a loudspeaker that is concurrently outputting audible sound. To detect movement by the person, the devices characterize the change in the frequency, or the Doppler shift, of the reflections of the ultrasonic signals off the person caused by the movement of the person. However, when a loudspeaker plays audible sound while emitting the ultrasonic signal, audio signals generated by microphones of the devices include distortions caused by the loudspeaker. These distortions can be interpreted by the presence-detection devices as indicating movement of a person when there is no movement, or as indicating lack of movement when a user is moving. The techniques include processing audio signals to remove distortions to more accurately identify changes in the frequency of the reflections of the ultrasonic signals caused by the movement of the person.
-
公开(公告)号:US10911881B1
公开(公告)日:2021-02-02
申请号:US16582091
申请日:2019-09-25
Applicant: Amazon Technologies, Inc.
Inventor: Savaskan Bulek , Tarun Pruthi , Ali Abdollahzadeh Milani , Trausti Thor Kristjansson
IPC: H04R29/00 , H04R3/00 , G10L19/008 , H04M1/68
Abstract: A system configured to detect a tap event on a surface of a device only using microphone audio data. For example, instead of using a physical sensor to detect the tap event, the device may detect a tap event in proximity to a microphone based on a power level difference between two or more microphones. When a power ratio exceeds a threshold, the device may detect a tap event and perform an action. For example, the device may output an alarm and use a detected tap event as an input to delay or end the alarm. In some examples, the device may detect a tap event using a plurality of microphones. Additionally or alternatively, the device may distinguish between multiple tap events based on a location of the tap event, enabling the device to perform two separate actions depending on the location.
-
公开(公告)号:US11727912B1
公开(公告)日:2023-08-15
申请号:US17707125
申请日:2022-03-29
Applicant: Amazon Technologies, Inc.
Inventor: Harsha Inna Kedage Rao , Srivatsan Kandadai , Minje Kim , Tarun Pruthi , Trausti Thor Kristjansson
IPC: G10K11/178 , G10K11/175
CPC classification number: G10K11/17854 , G10K11/1754 , G10K11/17823 , G10K11/17825 , G10K11/17881 , G10K2210/3026 , G10K2210/3027 , G10K2210/3028 , G10K2210/3038 , G10K2210/505
Abstract: A system configured to perform deep adaptive acoustic echo cancellation (AEC) to improve audio processing. Due to mechanical noise and continuous echo path changes caused by movement of a device, echo signals are nonlinear and time-varying and not fully canceled by linear AEC processing alone. To improve echo cancellation, deep adaptive AEC processing integrates a deep neural network (DNN) and linear adaptive filtering to perform echo and/or noise removal. The DNN is configured to generate a nonlinear reference signal and step-size data, which the linear adaptive filtering uses to generate output audio data representing local speech. The DNN may generate the nonlinear reference signal by generating mask data that is applied to a microphone signal, such that the reference signal corresponds to a portion of the microphone signal that does not include near-end speech.
-
公开(公告)号:US11513216B1
公开(公告)日:2022-11-29
申请号:US17171455
申请日:2021-02-09
Applicant: Amazon Technologies, Inc.
Inventor: Krishna Kamath Koteshwara , Rui Wang , Tarun Pruthi
Abstract: Techniques for calibrating presence-detection devices to account for various factors that can affect the presence-detection devices' ability to detect movement. Presence-detection devices may detect movement of a person in an environment by emitting ultrasonic signals into the environment, and characterizing the change in the frequency, or the Doppler shift, of the reflections of the ultrasonic signals off the person caused by the movement of the person. However, factors such as environmental acoustic conditions, noise sources, etc., may affect the ability of the presence-detection devices to detect movement. To calibrate for these factors, the presence-detection devices may use a loudspeaker to emit an ultrasonic sweep signal that spans different frequencies in an ultrasonic frequency range. The presence-detection devices may generate audio data using a microphone that represents the ultrasonic sweep signal, and analyze that audio data to determine an optimal frequency range and/or transmission power for subsequent ultrasonic signal transmissions.
-
公开(公告)号:US20210144499A1
公开(公告)日:2021-05-13
申请号:US17155145
申请日:2021-01-22
Applicant: Amazon Technologies, Inc.
Inventor: Savaskan Bulek , Tarun Pruthi , Ali Abdollahzadeh Milani , Trausti Thor Kristjansson
IPC: H04R29/00 , H04R3/00 , G10L19/008
Abstract: A system configured to detect a tap event on a surface of a device only using microphone audio data. For example, instead of using a physical sensor to detect the tap event, the device may detect a tap event in proximity to a microphone based on a power level difference between two or more microphones. When a power ratio exceeds a threshold, the device may detect a tap event and perform an action. For example, the device may output an alarm and use a detected tap event as an input to delay or end the alarm. In some examples, the device may detect a tap event using a plurality of microphones. Additionally or alternatively, the device may distinguish between multiple tap events based on a location of the tap event, enabling the device to perform two separate actions depending on the location.
-
公开(公告)号:US11921187B1
公开(公告)日:2024-03-05
申请号:US17232649
申请日:2021-04-16
Applicant: Amazon Technologies, Inc.
Inventor: Spencer Russell , Krishna Kamath Koteshwara , Tarun Pruthi , Trausti Thor Kristjansson , Anran Wang
CPC classification number: G01S13/56 , G01S7/4056 , G01S13/581 , G01S13/584 , G01S13/84
Abstract: Techniques for monitoring devices to use ultrasonic signals to detect and track the locations of moving objects in an environment. To determine distance information, the monitoring devices emit a frequency-modulated continuous wave (FMCW) signal at an ultrasound frequency range. Reflections of the FMCW ultrasonic signal are used to generate time-of-arrival (TOA) profiles that indicate distances between the monitoring device and objects in the environment. The reflections can be processed to suppress undesirable interferences, such as reflections off non-mobile objects in the environment (e.g., walls, furniture, etc.), vibrations off the floorings or the ceilings, etc. After processing the reflections, a heatmap can be used to plot the intensity of the reflections for the different TOAs of the reflections, and depict the movement of the user over time. Finally, a Kalman filter is used to smooth the peaks in the intensity values on the plot, and determine the trajectory of the human.
-
-
-
-
-
-
-
-
-