公开(公告)号：US20190342456A1

公开(公告)日：2019-11-07

申请号：US16456789

申请日：2019-06-28

Applicant: Cisco Technology, Inc.

Inventor： Haohai Sun ,  Johan Ludvig Nielsen

IPC: H04M9/08 ,  G10L21/0208

Abstract: A loudspeaker is driven with a loudspeaker signal to generate sound, and sound is converted to one or more microphone signals with one or more microphones. The microphone signals are concurrently transformed into far-field beam signals and near-field beam signals. The far-field beam signals and the near-field beam signals are concurrently processed to produce one or more far-field output signals and one or more near-field output signals, respectively. Echo is detected and canceled in the far-field beam signals and in the near-field beam signals. When the echo is not detected above a threshold, the one or more far-field output signals are outputted. When the echo is detected above the threshold, the one or more near-field output signals are outputted. A signal based on the one or more output signals is transmitted.

公开(公告)号：US09385779B2

公开(公告)日：2016-07-05

申请号：US14098064

申请日：2013-12-05

Applicant: CISCO TECHNOLOGY, INC.

Inventor： Haohai Sun

IPC: H04B3/20 ,  H04R29/00 ,  A61F11/06 ,  G10K11/16 ,  H03B29/00 ,  H04R3/00 ,  H04B3/23 ,  G10L25/51 ,  H04N7/15 ,  G10L21/0208

CPC classification number: H04B3/23 ,  G10L25/51 ,  G10L2021/02082 ,  H04M9/082 ,  H04M2250/20 ,  H04N7/15 ,  H04R3/005

Abstract: A processing system can include a tracking microphone array; audio tracker circuitry connected to the tracking microphone array to track an audio source based on an audio input from the array; communication microphones; and a processor. The processor can include audio circuitry to receive an audio input from the communication microphones and process the audio input to apply one or more of acoustic echo cancellation (AEC) and acoustic echo suppression (AES) processing to the audio input. The processor can further include calculating circuitry to calculate a ratio of signal power after and before the AEC and/or the AES processing, and control circuitry to generate an acoustic echo presence indication based on the ratio calculated by the calculating circuitry. The processor can transmit, via transmitting circuitry, the acoustic echo presence indication to an audio tracking device via a data communication channel between the processor and the audio tracker.

Abstract translation: 处理系统可以包括跟踪麦克风阵列; 连接到跟踪麦克风阵列的音频跟踪器电路基于来自阵列的音频输入来跟踪音频源; 通讯麦克风; 和处理器。 处理器可以包括音频电路，以从通信麦克风接收音频输入，并处理音频输入以将一个或多个声学回声消除（AEC）和声学回声抑制（AES）处理应用于音频输入。 处理器还可以包括计算电路以计算在AEC和/或AES处理之前和之后的信号功率的比率，以及控制电路，以基于由计算电路计算的比率来生成声学回声存在指示。 处理器可以经由发送电路经由处理器和音频跟踪器之间的数据通信信道将声学回声存在指示发送到音频跟踪装置。

公开(公告)号：US10687139B2

公开(公告)日：2020-06-16

申请号：US16576890

申请日：2019-09-20

Applicant: Cisco Technology, Inc.

Inventor： Gisle Langen Enstad ,  Haohai Sun ,  Johan Ludvig Nielsen

IPC: H04R3/00 ,  H04R1/40 ,  H04R3/04

Abstract: A microphone array includes one or more front-facing microphones disposed on a front surface of the collaboration endpoint and a plurality of secondary microphones disposed on a second surface of the collaboration endpoint. The sound signals received at each of the one or more front-facing microphones and the plurality of secondary microphones are converted into microphone signals. When the sound signals have a frequency below a threshold frequency, an output signal is generated from microphone signals generated by the one or more front-facing microphones and the plurality of secondary microphones. When the sound signals have a frequency at or above a threshold frequency, an output signal is generated from microphone signals generated by only the one or more front-facing microphones.

公开(公告)号：US20200120418A1

公开(公告)日：2020-04-16

申请号：US16576890

申请日：2019-09-20

Applicant: Cisco Technology, Inc.

Inventor： Gisle Langen Enstad ,  Haohai Sun ,  Johan Ludvig Nielsen

IPC: H04R3/00 ,  H04R3/04 ,  H04R1/40

Abstract: A microphone array includes one or more front-facing microphones disposed on a front surface of the collaboration endpoint and a plurality of secondary microphones disposed on a second surface of the collaboration endpoint. The sound signals received at each of the one or more front-facing microphones and the plurality of secondary microphones are converted into microphone signals. When the sound signals have a frequency below a threshold frequency, an output signal is generated from microphone signals generated by the one or more front-facing microphones and the plurality of secondary microphones. When the sound signals have a frequency at or above a threshold frequency, an output signal is generated from microphone signals generated by only the one or more front-facing microphones.

公开(公告)号：US10375474B2

公开(公告)日：2019-08-06

申请号：US15620169

申请日：2017-06-12

Applicant: Cisco Technology, Inc.

Inventor： Rune Skramstad ,  Haohai Sun

IPC: H04R3/00 ,  H04R1/40 ,  H04R1/30 ,  H04R3/04 ,  H04R1/20

Abstract: The disclosed technology relates to a microphone array. The array comprises a plurality of microphones with each microphone having a horn portion. Each microphone of the array further comprises an instrument disposed at a distal end of the horn portion. Each instrument of the array is configured to convert sound waves into an electrical signal. The microphone array further comprises a beamforming signal processing circuit electrically coupled to each instrument and configured to create a plurality of beam signals based on respective electrical signals.

公开(公告)号：US09215543B2

公开(公告)日：2015-12-15

申请号：US14095180

申请日：2013-12-03

Applicant: CISCO TECHNOLOGY, INC.

Inventor： Haohai Sun ,  Bjorn Winsvold

IPC: H04N7/15 ,  H04R29/00 ,  H04L12/18 ,  H04M3/56 ,  G10L25/48 ,  G06K9/00 ,  G10L25/78 ,  G10L21/0216

CPC classification number: H04R29/008 ,  G06K9/00221 ,  G10L25/48 ,  G10L25/78 ,  G10L2021/02166 ,  H04L12/1822 ,  H04M3/56 ,  H04N7/147 ,  H04N7/15 ,  H04R29/004

Abstract: A processing system can include a processor that includes circuitry. The circuitry can be configured to: receive far-end and near-end audio signals; detect silence events and voice activities from the audio signals; determine whether an audio event in the audio signals is an interference event or a speaker event based on the detected silence events and voice activities, and further based on localized acoustic source data and faces or motion detected from an image; and generate a mute or unmute indication based on whether the audio event is the interference event or the speaker event. The system can include a near-end microphone array to output the near-end audio signals, one or more far-end microphones to output the far-end audio signals, and one or more cameras to capture the image of the environment.

Abstract translation: 处理系统可以包括包括电路的处理器。 电路可以配置为：接收远端和近端音频信号; 从音频信号中检测静音事件和语音活动; 基于检测到的静音事件和语音活动，确定音频信号中的音频事件是干扰事件还是扬声器事件，并且还基于局部声源数据和从图像检测到的面部或运动; 并且基于音频事件是干扰事件还是说话人事件来产生静音或非静音指示。 该系统可以包括近端麦克风阵列以输出近端音频信号，一个或多个远端麦克风输出远端音频信号，以及一个或多个相机来捕获环境图像。

公开(公告)号：US20180041835A1

公开(公告)日：2018-02-08

申请号：US15785545

申请日：2017-10-17

Applicant: Cisco Technology, Inc.

Inventor： Haohai Sun

IPC: H04R3/00 ,  H04R29/00

CPC classification number: H04R3/005 ,  G10L21/0272 ,  G10L2021/02082 ,  H04R3/02 ,  H04R29/005 ,  H04R2201/401 ,  H04R2410/01 ,  H04R2430/20 ,  H04R2499/15

Abstract: At a microphone array, a soundfield is detected to produce a set of microphone signals each from a corresponding microphone in the microphone array. The set of microphone signals represents the soundfield. The detected soundfield is decomposed into a set of sub-soundfield signals based on the set of microphone signals. Each sub-soundfield signal is processed, such that each sub-soundfield signal is separately dereverberated using other ones of the sub-soundfield signals to remove reverberation from the sub-soundfield signal, to produce a set of processed sub-soundfield signals. The set of processed sub-sound field signals are mixed into a mixed output signal.

公开(公告)号：US09813811B1

公开(公告)日：2017-11-07

申请号：US15170495

申请日：2016-06-01

Applicant: Cisco Technology, Inc.

Inventor： Haohai Sun

IPC: H04B3/20 ,  H04R3/00 ,  H04R29/00

CPC classification number: H04R3/005 ,  G10L21/0272 ,  G10L2021/02082 ,  H04R3/02 ,  H04R29/005 ,  H04R2201/401 ,  H04R2410/01 ,  H04R2430/20 ,  H04R2499/15

Abstract: At a microphone array, a soundfield is detected to produce a set of microphone signals each from a corresponding microphone in the microphone array. The set of microphone signals represents the soundfield. The detected soundfield is decomposed into a set of sub-soundfield signals based on the set of microphone signals. Each sub-soundfield signal is processed, such that each sub-soundfield signal is separately dereverberated to remove reverberation therefrom, to produce a set of processed sub-soundfield signals. The set of processed sub-sound field signals are mixed into a mixed output signal.

公开(公告)号：US09338544B2

公开(公告)日：2016-05-10

申请号：US14294667

申请日：2014-06-03

Applicant: Cisco Technology, Inc.

Inventor： Haohai Sun ,  Bjørn Winsvold ,  Per Waagø ,  Amund Holmboe Basmo ,  Øystein Bredvei

IPC: H04N7/15 ,  H04R1/32 ,  G06K9/00 ,  H04M3/56 ,  H04N5/232 ,  H04N5/77 ,  H04N7/14 ,  H04R3/00

CPC classification number: H04R1/326 ,  G06K9/00221 ,  H04L12/1827 ,  H04M3/56 ,  H04M2203/509 ,  H04N5/23206 ,  H04N5/23212 ,  H04N5/23219 ,  H04N5/23222 ,  H04N5/23293 ,  H04N5/23296 ,  H04N5/772 ,  H04N7/142 ,  H04N7/147 ,  H04N7/15 ,  H04R3/005 ,  H04R27/00 ,  H04R29/007 ,  H04R2201/40

Abstract: A video conference endpoint determines a position of a best audio pick-up region for placement of a sound source relative to a microphone having a receive pattern configured to capture sound signals from the best region. The endpoint captures an image of a scene that encompasses the best region and displays the image of the scene. The endpoint generates an image representative of the best region and displays the generated image representative of the best region as an overlay of the scene image.

Abstract translation: 视频会议端点确定用于放置声源的最佳音频拾取区域相对于具有被配置为从最佳区域捕获声音信号的接收模式的麦克风的位置。 端点捕获包含最佳区域的场景的图像，并显示场景的图像。 端点产生表示最佳区域的图像，并将表示最佳区域的生成图像显示为场景图像的叠加。

公开(公告)号：US09226062B2

公开(公告)日：2015-12-29

申请号：US14218217

申请日：2014-03-18

Applicant: Cisco Technology, Inc.

Inventor： Haohai Sun ,  Espen Moberg ,  Bjørn Winsvold

IPC: H04R3/00 ,  H04R1/40 ,  H04N7/15 ,  G10L19/008

CPC classification number: H04R1/406 ,  G10L19/008 ,  H04N7/15 ,  H04R3/005 ,  H04R2201/405 ,  H04R2430/21 ,  H04R2499/15

Abstract: A telepresence video conference endpoint device includes spaced-apart microphone arrays each configured to transduce sound into corresponding sound signals. A processor receives the sound signals from the arrays and determines a direction-of-arrival (DOA) of sound at each array based on the set of sound signals from that array, determines if each array is blocked or unblocked based on the DOA determined for that array, selects an array among the arrays based on whether each array is determined to be blocked or unblocked, and perform subsequent sound processing based on one or more of the sound signals from the selected array.

Abstract translation: 远程呈现视频会议端点设备包括间隔开的麦克风阵列，每个配置用于将声音转换成对应的声音信号。 处理器从阵列接收声音信号，并且基于来自该阵列的声音信号的集合确定每个阵列处的声音到达方向（DOA），基于为每个阵列确定的DOA确定每个阵列是否被阻塞或解除阻塞 该阵列基于每个阵列是否被确定为阻塞或解除阻塞来选择阵列中的阵列，并且基于来自所选阵列的一个或多个声音信号执行后续的声音处理。