公开(公告)号：US10073521B2

公开(公告)日：2018-09-11

申请号：US15645365

申请日：2017-07-10

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Jongwon Shin ,  Erik Visser

IPC: G06F3/01 ,  H04N7/15 ,  G04G21/00 ,  G10L25/48 ,  H04M3/56 ,  H04R3/00 ,  H04R1/40 ,  G06F1/16 ,  H04S7/00 ,  G10L21/0216 ,  G10L17/00 ,  G01S3/808 ,  H04R29/00

CPC classification number: G06F3/013 ,  G01S3/8083 ,  G04G21/00 ,  G06F1/1613 ,  G06F3/011 ,  G10L17/00 ,  G10L25/48 ,  G10L2021/02166 ,  H04M3/568 ,  H04N7/15 ,  H04R1/406 ,  H04R3/005 ,  H04R29/005 ,  H04S7/304

Abstract: Disclosed is an application interface that takes into account the user's gaze direction relative to who is speaking in an interactive multi-participant environment where audio-based contextual information and/or visual-based semantic information is being presented. Among these various implementations, two different types of microphone array devices (MADs) may be used. The first type of MAD is a steerable microphone array (a.k.a. a steerable array) which is worn by a user in a known orientation with regard to the user's eyes, and wherein multiple users may each wear a steerable array. The second type of MAD is a fixed-location microphone array (a.k.a. a fixed array) which is placed in the same acoustic space as the users (one or more of which are using steerable arrays).

公开(公告)号：US10002478B2

公开(公告)日：2018-06-19

申请号：US14966815

申请日：2015-12-11

Applicant: QUALCOMM Incorporated

Inventor： Shaun William Van Dyken ,  Erik Visser ,  Asif Iqbal Mohammad ,  Samir Kumar Gupta ,  Lae-Hoon Kim ,  Sreekanth Narayanaswamy ,  Phuong Ton

IPC: G07C9/00 ,  G06F21/32 ,  G06K9/00 ,  H04R3/00

CPC classification number: G07C9/00158 ,  G06F21/32 ,  G06K9/00288 ,  G06K9/00335 ,  H04R3/005

Abstract: A system includes a memory configured to store data associated with a service that is available. The system also includes a microphone associated with an acoustic space and configured to receive an audio input produced by a person. The system further includes a sensor located within the acoustic space and configured to detect vibrations produced by the person. The system includes a processor coupled to the memory, to the microphone, and to the sensor. The processor is configured to conditionally authorize execution of the service requested by the person, the service conditionally authorized based on the audio input and the vibrations.

公开(公告)号：US20170193976A1

公开(公告)日：2017-07-06

申请号：US15216577

申请日：2016-07-21

Applicant: QUALCOMM Incorporated

Inventor： Asif Mohammad ,  Sreekanth Narayanaswamy ,  Wade Heimbigner ,  Erik Visser

IPC: G10K11/178

CPC classification number: G10K11/178 ,  G10K2210/12821 ,  G10L21/0208 ,  G10L2021/02082 ,  H04M3/002 ,  H04M9/082 ,  H04R3/02 ,  H04R2499/11 ,  H04R2499/13

Abstract: A system includes a feedback filter configured to receive an audio signal from a microphone and to process the audio signal based on a feedback path between a loudspeaker and the microphone. The system also includes an adaptive filter coupled to the feedback filter. The system further includes a signal combiner coupled to the microphone and to the adaptive filter.

公开(公告)号：US09666183B2

公开(公告)日：2017-05-30

申请号：US14671850

申请日：2015-03-27

Applicant: QUALCOMM Incorporated

Inventor： Erik Visser ,  Yinyi Guo ,  Lae-Hoon Kim ,  Raghuveer Peri ,  Shuhua Zhang

IPC: G10L15/00 ,  G10L15/16 ,  G10L25/51 ,  G10L25/30 ,  G10L13/00 ,  G10L15/02 ,  G10L15/06 ,  G10L21/0208 ,  G10L21/0272

CPC classification number: G10L15/16 ,  G10L15/02 ,  G10L15/063 ,  G10L21/0208 ,  G10L21/0272 ,  G10L25/30 ,  G10L25/51

Abstract: Disclosed is a feature extraction and classification methodology wherein audio data is gathered in a target environment under varying conditions. From this collected data, corresponding features are extracted, labeled with appropriate filters (e.g., audio event descriptions), and used for training deep neural networks (DNNs) to extract underlying target audio events from unlabeled training data. Once trained, these DNNs are used to predict underlying events in noisy audio to extract therefrom features that enable the separation of the underlying audio events from the noisy components thereof.

公开(公告)号：US09536537B2

公开(公告)日：2017-01-03

申请号：US14634637

申请日：2015-02-27

Applicant: QUALCOMM Incorporated

Inventor： Yinyi Guo ,  Shuhua Zhang ,  Erik Visser ,  Lae-Hoon Kim ,  Sanghyun Chi

IPC: G10L21/0208 ,  G10L21/034 ,  H03G5/00 ,  H03G5/16 ,  G10L21/0232

CPC classification number: G10L21/0208 ,  G10L21/0232 ,  G10L21/034 ,  H03G5/005 ,  H03G5/165

Abstract: A method for speech restoration by an electronic device is described. The method includes obtaining a noisy speech signal. The method also includes suppressing noise in the noisy speech signal to produce a noise-suppressed speech signal. The noise-suppressed speech signal has a bandwidth that includes at least three subbands. The method further includes iteratively restoring each of the at least three subbands. Each of the at least three subbands is restored based on all previously restored subbands of the at least three subbands.

Abstract translation: 描述了一种通过电子设备进行语音恢复的方法。 该方法包括获得噪声语音信号。 该方法还包括抑制噪声语音信号中的噪声以产生噪声抑制语音信号。 噪声抑制语音信号具有包括至少三个子带的带宽。 该方法还包括迭代地恢复至少三个子带中的每一个。 所述至少三个子带中的每一个基于所述先前恢复的所述至少三个子带的子带被恢复。

公开(公告)号：US09532140B2

公开(公告)日：2016-12-27

申请号：US15014952

申请日：2016-02-03

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Phuong Lam Ton ,  Erik Visser ,  Jeremy P. Toman ,  Francis Bernard MacDougall

IPC: H04R3/00 ,  H04R1/32 ,  G10L15/25 ,  G06K9/00 ,  G10L21/02 ,  H04N7/14 ,  G10L21/0208 ,  H04R1/40 ,  G10L21/0216

CPC classification number: H04R3/005 ,  G06K9/00221 ,  G06K9/00315 ,  G10L15/25 ,  G10L21/02 ,  G10L21/0208 ,  G10L2021/02166 ,  H04N7/147 ,  H04R1/326 ,  H04R1/406

Abstract: One example device includes a camera; a display device; a memory; and a processor in communication with the memory to receive audio signals from two or more microphones or a far-end device; receive first location information and second location information, the first location information for a visual identification of an audio source of the received audio signals and the second location information identifying a direction of arrival from the audio source; receive a first adjustment to a first portion of a UI to change either a visual identification or a coordinate direction of a direction focus; in response to the first adjustment, automatically perform a second adjustment to a second portion of the UI to change the other of the visual identification or the coordinate direction of the direction focus; and process the audio signals to filter sounds outside the direction focus, or emphasize sounds within the direction focus.

Abstract translation: 一个示例性设备包括摄像机; 显示装置; 记忆 以及与所述存储器通信以从两个或更多个麦克风或远端设备接收音频信号的处理器; 接收第一位置信息和第二位置信息，用于视觉识别所接收的音频信号的音频源的第一位置信息和识别来自音频源的到达方向的第二位置信息; 接收对UI的第一部分的第一调整以改变方向焦点的视觉识别或坐标方向; 响应于第一调整，自动对UI的第二部分进行第二调整，以改变视觉识别或方向焦点的坐标方向上的另一个; 并处理音频信号以过滤方向焦点外的声音，或强调方向焦点内的声音。

公开(公告)号：US09430628B2

公开(公告)日：2016-08-30

申请号：US14577878

申请日：2014-12-19

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Juhan Nam ,  Erik Visser

IPC: G06Q40/00 ,  G07D11/00 ,  G07F19/00 ,  G06K5/00 ,  G06K7/01 ,  G06F21/32 ,  G06K9/00 ,  G06Q20/40 ,  H04L9/32 ,  H04L9/08

CPC classification number: G06F21/32 ,  G06K9/00006 ,  G06K9/00067 ,  G06K9/00073 ,  G06K9/0008 ,  G06K9/0061 ,  G06K9/00926 ,  G06K2009/00953 ,  G06Q20/40145 ,  H04L9/0844 ,  H04L9/3231

Abstract: A method of selectively authorizing access includes obtaining, at an authentication device, first information corresponding to first synthetic biometric data. The method also includes obtaining, at the authentication device, first common synthetic data and second biometric data. The method further includes generating, at the authentication device, second common synthetic data based on the first information and the second biometric data. The method also includes selectively authorizing, by the authentication device, access based on a comparison of the first common synthetic data and the second common synthetic data.

Abstract translation: 选择性授权访问的方法包括在认证设备处获得与第一合成生物测定数据相对应的第一信息。 该方法还包括在认证设备处获取第一公共合成数据和第二生物测定数据。 该方法还包括在认证设备处基于第一信息和第二生物测定数据生成第二公共合成数据。 该方法还包括由认证设备选择性地授权基于第一公共合成数据和第二公共合成数据的比较的访问。

公开(公告)号：US20160171964A1

公开(公告)日：2016-06-16

申请号：US14808746

申请日：2015-07-24

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Asif Iqbal Mohammad ,  Erik Visser

IPC: G10K11/178 ,  H04R27/00

CPC classification number: G10K11/178 ,  G10L21/02 ,  G10L2021/02082 ,  H04M9/082 ,  H04R3/02 ,  H04R5/02 ,  H04R27/00 ,  H04R2227/009 ,  H04R2499/13 ,  H04S7/00 ,  H04S7/302

Abstract: A crosstalk cancellation technique reduces feedback in a shared acoustic space by canceling out some or all parts of sound signals that would otherwise be produced by a loudspeaker to only be captured by a microphone that, recursively, would cause these sounds signals to be reproduced again on the loudspeaker as feedback. Crosstalk cancellation can be used in a multichannel acoustic system (MAS) comprising an arrangement of microphones, loudspeakers, and a processor to together enhance conversational speech between in a shared acoustic space. To achieve crosstalk cancellation, a processor analyzes the inputs of each microphone, compares it to the output of far loudspeaker(s) relative to each such microphone, and cancels out any portion of a sound signal received by the microphone that matches signals that were just produced by the far loudspeaker(s) and sending only the remaining sound signal (if any) to such far loudspeakers.

Abstract translation: 串扰消除技术通过消除由扬声器产生的仅由麦克风捕获的声音信号的一些或所有部分来减少共享声学空间中的反馈，递归地将使这些声音信号再次被再现 扬声器作为反馈。 串扰消除可以用在包括麦克风，扬声器和处理器的布置的多声道声学系统（MAS）中，以一起增强共享声学空间之间的会话语音。 为了实现串扰消除，处理器分析每个麦克风的输入，将其与相对于每个这样的麦克风的远扬声器的输出进行比较，并且取消与麦克风接收的声音信号匹配的信号的任何部分 由远扬声器产生并且仅将剩余的声音信号（如果有的话）发送到这样的远扬声器。

公开(公告)号：US20160157013A1

公开(公告)日：2016-06-02

申请号：US15014952

申请日：2016-02-03

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Phuong Lam Ton ,  Erik Visser ,  Jeremy P. Toman ,  Francis Bernard MacDougall

IPC: H04R3/00 ,  G10L15/25 ,  G10L21/0208 ,  H04R1/40

CPC classification number: H04R3/005 ,  G06K9/00221 ,  G06K9/00315 ,  G10L15/25 ,  G10L21/02 ,  G10L21/0208 ,  G10L2021/02166 ,  H04N7/147 ,  H04R1/326 ,  H04R1/406

Abstract: Systems, devices, and methods are described for recognizing and focusing on at least one source of an audio communication as part of a communication including a video image and an audio communication derived from two or more microphones when a relative position between the microphones is known. In certain embodiments, linked audio and video focus areas providing location information for one or more sound sources may each be associated with different user inputs, and an input to adjust a focus in either the audio or video domain may automatically adjust the focus in the another domain.

公开(公告)号：US09354295B2

公开(公告)日：2016-05-31

申请号：US13833982

申请日：2013-03-15

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Erik Visser

IPC: G01S3/80 ,  H04R3/00 ,  H04R1/08 ,  G01B21/00 ,  G06F3/0484 ,  G06F3/16 ,  G01S15/87 ,  G01S5/18 ,  G10L21/0216 ,  G06F1/16

CPC classification number: G01S3/8006 ,  G01B21/00 ,  G01S3/80 ,  G01S3/8083 ,  G01S5/18 ,  G01S5/186 ,  G01S15/025 ,  G01S15/876 ,  G06F1/1633 ,  G06F3/0484 ,  G06F3/167 ,  G10L2021/02166 ,  H04R1/08 ,  H04R3/00 ,  H04R3/005

Abstract: Systems, methods, and apparatus for matching pair-wise differences (e.g., phase delay measurements) to an inventory of source direction candidates, and application of pair-wise source direction estimates, are described.

Abstract translation: 描述了用于将成对差异（例如，相位延迟测量）与源方向候选的库存匹配的系统，方法和装置以及成对的源方向估计的应用。