公开(公告)号：US12051429B2

公开(公告)日：2024-07-30

申请号：US18138684

申请日：2023-04-24

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Shankar Thagadur Shivappa ,  S M Akramus Salehin ,  Shuhua Zhang ,  Erik Visser

IPC: G10L19/008 ,  G10L19/002 ,  G10L19/038 ,  H04R5/00

CPC classification number: G10L19/038 ,  G10L19/002 ,  H04R5/00 ,  G10L19/008 ,  H04R2430/21 ,  H04S2420/11

Abstract: A device includes a memory configured to store untransformed ambisonic coefficients at different time segments. The device includes one or more processors configured to obtain the untransformed ambisonic coefficients at the different time segments, where the untransformed ambisonic coefficients at the different time segments represent a soundfield at the different time segments. The one or more processors are configured to apply one adaptive network, based on a constraint that includes preservation of a spatial direction of one or more audio sources in the soundfield at the different time segments, to the untransformed ambisonic coefficients at the different time segments to generate transformed ambisonic coefficients at the different time segments, wherein the transformed ambisonic coefficients at the different time segments represent a modified soundfield at the different time segments, that was modified based on the constraint. The one or more processors are also configured to apply an additional adaptive network.

公开(公告)号：US11804233B2

公开(公告)日：2023-10-31

申请号：US16685987

申请日：2019-11-15

Applicant: QUALCOMM incorporated

Inventor： Lae-Hoon Kim ,  Dongmei Wang ,  Cheng-Yu Hung ,  Erik Visser

IPC: G10L21/02 ,  G06T5/10 ,  G10L15/16 ,  G10L15/22 ,  G10L21/0232 ,  G10L21/0364 ,  G10L25/78 ,  G06V40/16 ,  G06V10/764 ,  G06V10/82 ,  G06V10/30 ,  G10L21/0208 ,  H04B1/06

CPC classification number: G10L21/02 ,  G06T5/10 ,  G06V10/30 ,  G06V10/764 ,  G06V10/82 ,  G06V40/16 ,  G06V40/161 ,  G10L15/16 ,  G10L15/22 ,  G10L21/0232 ,  G10L21/0364 ,  G10L25/78 ,  G10L2021/02082 ,  H04B1/06

Abstract: A device includes one or more processors configured to perform signal processing including a linear transformation and a non-linear transformation of an input signal to generate a reference target signal. The reference target signal has a linear component associated with the linear transformation and a non-linear component associated with the non-linear transformation. The one or more processors are also configured to perform linear filtering of the input signal by controlling adaptation of the linear filtering to generate an output signal that substantially matches the linear component of the reference target signal.

公开(公告)号：US11743631B2

公开(公告)日：2023-08-29

申请号：US18063493

申请日：2022-12-08

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Dongmei Wang ,  Fatemeh Saki ,  Taher Shahbazi Mirzahasanloo ,  Erik Visser ,  Rogerio Guedes Alves

IPC: H03B29/00 ,  A61F11/06 ,  G10K11/16 ,  H04R1/10

CPC classification number: H04R1/1083 ,  H04R1/1075 ,  H04R2420/07 ,  H04R2460/01 ,  H04R2460/13

Abstract: A wearable device may include a processor configured to perform active noise cancelation (ANC) applied to an input audio signal received by at least one microphone, and detect a self-voice signal, based on one or more transducers. The processor may also be configured to apply a first filter to an external audio signal, detected by at least one external microphone on the wearable device, during a listen through operation based on an activation of the audio zoom feature to generate a first listen-through signal that includes the external audio signal. The processor may also be configured to after the activation of the audio zoom feature terminate a second filter that provides low frequency compensation. The processor may be configured to produce an output audio signal that is based on at least the first listen-through signal that includes the external signal, and is based on the detected self-voice signal.

公开(公告)号：US11715480B2

公开(公告)日：2023-08-01

申请号：US17209621

申请日：2021-03-23

Applicant: QUALCOMM Incorporated

Inventor： Kyungguen Byun ,  Shuhua Zhang ,  Lae-Hoon Kim ,  Erik Visser ,  Sunkuk Moon ,  Vahid Montazeri

IPC: G10L21/0232 ,  G10L21/038 ,  G10L21/02

CPC classification number: G10L21/0232 ,  G10L21/02 ,  G10L21/038

Abstract: A device to perform speech enhancement includes one or more processors configured to obtain input spectral data based on an input signal. The input signal represents sound that includes speech. The one or more processors are also configured to process, using a multi-encoder transformer, the input spectral data and context data to generate output spectral data that represents a speech enhanced version of the input signal.

公开(公告)号：US11671752B2

公开(公告)日：2023-06-06

申请号：US17316529

申请日：2021-05-10

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Fatemeh Saki ,  Yoon Mo Yang ,  Erik Visser

IPC: H04R1/40 ,  H04R1/24 ,  H04R5/033 ,  H04R5/04

CPC classification number: H04R1/406 ,  H04R1/245 ,  H04R5/033 ,  H04R5/04

Abstract: A device includes one or more processors configured to execute instructions to determine a first phase based on a first audio signal of first audio signals and to determine a second phase based on a second audio signal of second audio signals. The one or more processors are also configured to execute the instructions to apply spatial filtering to selected audio signals of the first audio signals and the second audio signals to generate an enhanced audio signal. The one or more processors are further configured to execute the instructions to generate a first output signal including combining a magnitude of the enhanced audio signal with the first phase and to generate a second output signal including combining the magnitude of the enhanced audio signal with the second phase. The first output signal and the second output signal correspond to an audio zoomed signal.

公开(公告)号：US11425497B2

公开(公告)日：2022-08-23

申请号：US17127421

申请日：2020-12-18

Applicant: QUALCOMM Incorporated

Inventor： S M Akramus Salehin ,  Lae-Hoon Kim ,  Vasudev Nayak ,  Shankar Thagadur Shivappa ,  Isaac Garcia Munoz ,  Sanghyun Chi ,  Erik Visser

IPC: H04R3/00 ,  G06K9/00 ,  G02B27/00 ,  H03G3/30 ,  G06V40/19

Abstract: In an aspect, a lens is zoomed in to create a zoomed lens. Lens data associated with the lens includes a direction of the lens relative to an object in a field-of-view of the zoomed lens and a magnification of the object resulting from the zoomed lens. An array of microphones capture audio signals including audio produced by the object and interference produced by other objects. The audio signals are processed to identify a directional component associated with the audio produced by the object and three orthogonal components associated with the interference produced by the other objects. Stereo beamforming is used to increase a magnitude of the directional component (relative to the interference) while retaining a binaural nature of the audio signals. The increase in magnitude of the directional component is based on an amount of the magnification provided by the zoomed lens to the object.

公开(公告)号：US11410677B2

公开(公告)日：2022-08-09

申请号：US17102724

申请日：2020-11-24

Applicant: QUALCOMM Incorporated

Inventor： Fatemeh Saki ,  Yinyi Guo ,  Erik Visser

IPC: H04R29/00 ,  G10L25/51 ,  G06N20/00 ,  G06N5/04 ,  H04R1/08

Abstract: A device includes one or more processors configured to provide audio data samples to a sound event classification model. The one or more processors are also configured to determine, based on an output of the sound event classification model responsive to the audio data samples, whether a sound class of with the audio data samples was recognized by the sound event classification model. The one or more processors are further configured to, based on a determination that the sound class was not recognized, determine whether the sound event classification model corresponds to an audio scene associated with the audio data samples. The one or more processors are also configured to, based on a determination that the sound event classification model corresponds to the audio scene associated with the audio data samples, store model update data based on the audio data samples.

公开(公告)号：US20220109930A1

公开(公告)日：2022-04-07

申请号：US17530320

申请日：2021-11-18

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Rogerio Guedes Alves ,  Jacob Jon Bean ,  Erik Visser

IPC: H04R3/04

Abstract: Methods, systems, and devices for signal processing are described. Generally, as provided for by the described techniques, a wearable device to receive an input audio signal from one or more outer microphones, an input audio signal from one or more inner microphones, and a bone conduction signal from a bone conduction sensor based on the input audio signals. The wearable device may filter the bone conduction signal based on a set of frequencies of the input audio signals, such as a low frequency portion of the input audio signals. For example, the wearable device may apply a filter to the bone conduction signal that accounts for an error in the input audio signals. The wearable device may add a gain to the filtered bone conduction signal and may equalize the filtered bone conduction signal based on the gain. The wearable device may output an audio signal to a speaker.

公开(公告)号：US10681452B1

公开(公告)日：2020-06-09

申请号：US16285923

申请日：2019-02-26

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Dongmei Wang ,  Fatemeh Saki ,  Taher Shahbazi Mirzahasanloo ,  Erik Visser ,  Rogerio Guedes Alves

IPC: A61F11/06 ,  G10K11/16 ,  H03B29/00 ,  H04R1/10

Abstract: Methods, systems, and devices for signal processing are described. Generally, as provided for by the described techniques, a wearable device may receive an input audio signal (e.g., including both an external signal and a self-voice signal). The wearable device may detect the self-voice signal in the input audio signal based on a self-voice activity detection (SVAD) procedure, and may implement the described techniques based thereon. The wearable device may perform beamforming operations or other separation procedures to isolate the external signal and the self-voice signal from the input audio signal. The wearable device may apply a first filter to the external signal, and a second filter to the self-voice signal. The wearable device may then mix the filtered signals, and generate an output signal that sounds natural to the user.

公开(公告)号：US20200178014A1

公开(公告)日：2020-06-04

申请号：US16206680

申请日：2018-11-30

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Dongmei Wang ,  Erik Visser

IPC: H04S7/00 ,  H04S3/00 ,  G06N3/08

Abstract: Methods, systems, and devices for head-related transfer function generation are described. A device may receive a digital representation of a first audio signal associated with a location relative to a subject, and select from a database a first reference head-related transfer function measurement pair corresponding to the location of the first audio signal. The device may then obtain a second head-related transfer function measurement pair by performing a style transfer operation on the selected reference head-related transfer function measurement pair based on a set of head-related transfer function measurement pairs specific to the subject. As a result, the device may output a second audio signal based on the digital representation of the first audio signal and the second head-related transfer function measurement pair.