公开(公告)号：US09426373B2

公开(公告)日：2016-08-23

申请号：US14096885

申请日：2013-12-04

Applicant: Cisco Technology, Inc.

Inventor： Feng Bao ,  Subrahmanyam Venkata Kunapuli ,  Fei Yang ,  Tor Sundsbarm ,  David Paul Wunsch Desrosiers ,  Olin Daniel Williford, Jr. ,  David Michael Sanguinet

IPC: H04N7/15 ,  H04N5/232

CPC classification number: H04N5/23296 ,  H04N5/232

Abstract: In one embodiment, a method includes obtaining a first signal from a first microphone, and determining when the first signal is indicative of activity on a first surface. The method also includes controlling a camera to focus on the first surface when it is determined that the first signal indicates the activity on the first surface. In such an embodiment, the first microphone and the camera may be part of a collaboration system, and the first surface may be a surface of a whiteboard.

Abstract translation: 在一个实施例中，一种方法包括从第一麦克风获取第一信号，以及确定第一信号何时指示第一表面上的活动。 当确定第一信号指示第一表面上的活动时，该方法还包括控制相机聚焦在第一表面上。 在这样的实施例中，第一麦克风和相机可以是协作系统的一部分，并且第一表面可以是白板的表面。

公开(公告)号：US20160205262A1

公开(公告)日：2016-07-14

申请号：US15073799

申请日：2016-03-18

Applicant: Cisco Technology, Inc.

Inventor： Feng Bao ,  Subrahmanyam Venkata Kunapuli ,  Fei Yang ,  Tor A. Sundsbarm

IPC: H04M9/08 ,  G10K11/178 ,  H04R3/02 ,  H04M3/56 ,  H04R3/00

CPC classification number: H04M9/082 ,  G10K11/178 ,  G10K2210/108 ,  G10K2210/3018 ,  G10K2210/3023 ,  H04M3/568 ,  H04M2203/509 ,  H04M2207/18 ,  H04R3/005 ,  H04R3/02 ,  H04R2499/11 ,  H04W88/02

Abstract: A controller for the conference session generates a speaker signal for speakers in a conference room. The controller correlates the speaker signal with network timing information and generates speaker timing information. The controller transmits the correlated speaker signal and timing information to a mobile device participating in the conference session. The mobile device generates an echo cancelled microphone signal from a microphone of the mobile device, and transmits the echo cancelled signal back to the controller. The controller also receives array microphone signals associated with an array of microphones at known positions in the room. The controller estimates a relative location of the mobile device within the conference room. The controller dynamically selects as audio output corresponding to the mobile device location either the echo cancelled microphone signal from the mobile device or an echo cancelled array microphone signal associated with the relative location of the mobile device.

Abstract translation: 用于会议会话的控制器为会议室中的扬声器生成扬声器信号。 控制器将扬声器信号与网络定时信息相关联，并产生扬声器定时信息。 控制器将相关的扬声器信号和定时信息发送到参与会议会话的移动设备。 移动设备从移动设备的麦克风产生回声消除的麦克风信号，并将回声消除的信号发送回控制器。 控制器还接收与房间中已知位置处的麦克风阵列相关联的阵列麦克风信号。 控制器估计移动设备在会议室内的相对位置。 控制器动态地选择与移动设备位置相对应的音频输出，即来自移动设备的回波消除的麦克风信号或与移动设备的相对位置相关联的回波消除的阵列麦克风信号。

公开(公告)号：US09894213B2

公开(公告)日：2018-02-13

申请号：US15073799

申请日：2016-03-18

Applicant: Cisco Technology, Inc.

Inventor： Feng Bao ,  Subrahmanyam Venkata Kunapuli ,  Fei Yang ,  Tor A. Sundsbarm

IPC: A61F11/06 ,  H04M9/08 ,  H04M3/56 ,  G10K11/178 ,  H04R3/00 ,  H04R3/02 ,  H04B1/38 ,  H04W88/02

CPC classification number: H04M9/082 ,  G10K11/178 ,  G10K2210/108 ,  G10K2210/3018 ,  G10K2210/3023 ,  H04M3/568 ,  H04M2203/509 ,  H04M2207/18 ,  H04R3/005 ,  H04R3/02 ,  H04R2499/11 ,  H04W88/02

Abstract: A controller for the conference session generates a speaker signal for speakers in a conference room. The controller correlates the speaker signal with network timing information and generates speaker timing information. The controller transmits the correlated speaker signal and timing information to a mobile device participating in the conference session. The mobile device generates an echo cancelled microphone signal from a microphone of the mobile device, and transmits the echo cancelled signal back to the controller. The controller also receives array microphone signals associated with an array of microphones at known positions in the room. The controller estimates a relative location of the mobile device within the conference room. The controller dynamically selects as audio output corresponding to the mobile device location either the echo cancelled microphone signal from the mobile device or an echo cancelled array microphone signal associated with the relative location of the mobile device.

公开(公告)号：US09319532B2

公开(公告)日：2016-04-19

申请号：US13967687

申请日：2013-08-15

Applicant: Cisco Technology, Inc.

Inventor： Feng Bao ,  Subrahmanyam Venkata Kunapuli ,  Fei Yang ,  Tor A. Sundsbarm

IPC: H04B3/20 ,  H04M9/08 ,  H04M3/56 ,  H04B1/38

CPC classification number: H04M9/082 ,  G10K11/178 ,  G10K2210/108 ,  G10K2210/3018 ,  G10K2210/3023 ,  H04M3/568 ,  H04M2203/509 ,  H04M2207/18 ,  H04R3/005 ,  H04R3/02 ,  H04R2499/11 ,  H04W88/02

Abstract: A controller for the conference session receives at least one audio signal to generate a speaker signal. The controller correlates the speaker signal with network timing information and generates speaker timing information. The controller transmits the correlated speaker signal and timing information to a mobile device participating in the conference session. The mobile device generates an echo cancelled microphone signal from a microphone of the mobile device, and transmits the echo cancelled signal back to the controller. The controller also receives array microphone signals associated with an array of microphones at known positions in the room. The controller removes acoustic echo from the array microphone signals, and estimates a relative location of the mobile device. The controller dynamically selects as audio output corresponding to the mobile device location either (a) the array microphone signal, or (b) the echo cancelled microphone signal from the mobile device.

Abstract translation: 用于会议会话的控制器接收至少一个音频信号以产生扬声器信号。 控制器将扬声器信号与网络定时信息相关联，并产生扬声器定时信息。 控制器将相关的扬声器信号和定时信息发送到参与会议会话的移动设备。 移动设备从移动设备的麦克风产生回声消除的麦克风信号，并将回声消除的信号发送回控制器。 控制器还接收与房间中已知位置处的麦克风阵列相关联的阵列麦克风信号。 控制器从阵列麦克风信号中去除声学回波，并估计移动设备的相对位置。 控制器动态地选择与移动设备位置相对应的音频输出（a）阵列麦克风信号，或（b）来自移动设备的回声消除的麦克风信号。

公开(公告)号：US20150156395A1

公开(公告)日：2015-06-04

申请号：US14096885

申请日：2013-12-04

Applicant: Cisco Technology, Inc.

Inventor： Feng Bao ,  Subrahmanyam Venkata Kunapuli ,  Fei Yang ,  Tor Sundsbarm ,  David Paul Wunsch Desrosiers ,  Olin Daniel Williford, JR. ,  David Michael Sanguinet

IPC: H04N5/232

CPC classification number: H04N5/23296 ,  H04N5/232

Abstract: In one embodiment, a method includes obtaining a first signal from a first microphone, and determining when the first signal is indicative of activity on a first surface. The method also includes controlling a camera to focus on the first surface when it is determined that the first signal indicates the activity on the first surface. In such an embodiment, the first microphone and the camera may be part of a collaboration system, and the first surface may be a surface of a whiteboard.

Abstract translation: 在一个实施例中，一种方法包括从第一麦克风获取第一信号，以及确定第一信号何时指示第一表面上的活动。 当确定第一信号指示第一表面上的活动时，该方法还包括控制相机聚焦在第一表面上。 在这样的实施例中，第一麦克风和相机可以是协作系统的一部分，并且第一表面可以是白板的表面。

公开(公告)号：US10313786B1

公开(公告)日：2019-06-04

申请号：US16010774

申请日：2018-06-18

Applicant: Cisco Technology, Inc.

Inventor： Feng Bao ,  David William Nolan Robison ,  Tor A. Sundsbarm ,  Fei Yang

IPC: H04R3/00 ,  G10L21/0232 ,  H04R1/40

Abstract: A device including an array of bidirectional microphones optimizes the echo rejection of the bidirectional microphones. The microphone array receives audio from an audio source and generates audio signals from each of the bidirectional microphones. The device forms audio beams from combinations of the audio signals generated from the microphone array. Each audio beam captures audio from either its positive polarity zone or its negative polarity zone. The device determines a direction of the audio source and selects a perpendicular audio beam pair based on the direction of the audio source. The perpendicular audio beam pair includes a primary audio beam aimed toward the direction of the audio source and a secondary beam perpendicular to the primary audio beam. The device generates an output signal by combining the primary audio beam with the secondary audio beam based on polarity zone the audio is captured for each audio beam.

公开(公告)号：US09451360B2

公开(公告)日：2016-09-20

申请号：US14154975

申请日：2014-01-14

Applicant: CISCO TECHNOLOGY, INC.

Inventor： Feng Bao ,  Subrahmanyam Kunapuli ,  Fei Yang ,  Tor Sundsbarm

IPC: H04R3/00 ,  H04M3/56 ,  H04N7/15

CPC classification number: H04R3/005 ,  H04M3/568 ,  H04M2203/509 ,  H04N7/15

Abstract: A processing system can include tracking microphone array(s), audio-tracking circuitry configured to detect a location of audio sources from audio signals from the array(s), and processing circuitry. The processing circuitry can be configured to: identify a first microphone that has a strongest signal strength; estimate a location of an active speaker based on at least an output of the audio-tracking circuitry; determine whether a second microphone for the active speaker is affected by an acoustic obstacle based on the location of the active speaker and a location of the first microphone that has the strongest signal strength; estimate attenuation for microphones based on a comparison of actual signal strengths of the microphones with estimated signal strengths of the microphones that are estimated based on microphone signals of the second microphone for the active speaker; and modify the attenuation based on an estimated location of the acoustic obstacle.

Abstract translation: 处理系统可以包括跟踪麦克风阵列，被配置为从来自阵列的音频信号和处理电路检测音频源的位置的音频跟踪电路。 处理电路可以被配置为：识别具有最强信号强度的第一麦克风; 至少基于音频跟踪电路的输出来估计有源扬声器的位置; 基于有源扬声器的位置和具有最强信号强度的第一麦克风的位置，确定主动扬声器的第二麦克风是否受到声学障碍物的影响; 基于麦克风的实际信号强度与基于用于主动扬声器的第二麦克风的麦克风信号估计的麦克风的估计信号强度进行比较来估计麦克风的衰减; 并且基于声学障碍物的估计位置来修改衰减。

公开(公告)号：US20150050967A1

公开(公告)日：2015-02-19

申请号：US13967687

申请日：2013-08-15

Applicant: Cisco Technology, Inc

Inventor： Feng Bao ,  Subrahmanyam Venkata Kunapuli ,  Fei Yang ,  Tor A. Sundsbarm

IPC: H04M9/08 ,  H04M3/56

CPC classification number: H04M9/082 ,  G10K11/178 ,  G10K2210/108 ,  G10K2210/3018 ,  G10K2210/3023 ,  H04M3/568 ,  H04M2203/509 ,  H04M2207/18 ,  H04R3/005 ,  H04R3/02 ,  H04R2499/11 ,  H04W88/02

Abstract: A controller for the conference session receives at least one audio signal to generate a speaker signal. The controller correlates the speaker signal with network timing information and generates speaker timing information. The controller transmits the correlated speaker signal and timing information to a mobile device participating in the conference session. The mobile device generates an echo cancelled microphone signal from a microphone of the mobile device, and transmits the echo cancelled signal back to the controller. The controller also receives array microphone signals associated with an array of microphones at known positions in the room. The controller removes acoustic echo from the array microphone signals, and estimates a relative location of the mobile device. The controller dynamically selects as audio output corresponding to the mobile device location either (a) the array microphone signal, or (b) the echo cancelled microphone signal from the mobile device.

Abstract translation: 用于会议会话的控制器接收至少一个音频信号以产生扬声器信号。 控制器将扬声器信号与网络定时信息相关联，并产生扬声器定时信息。 控制器将相关的扬声器信号和定时信息发送到参与会议会话的移动设备。 移动设备从移动设备的麦克风产生回声消除的麦克风信号，并将回声消除的信号发送回控制器。 控制器还接收与房间中已知位置处的麦克风阵列相关联的阵列麦克风信号。 控制器从阵列麦克风信号中去除声学回波，并估计移动设备的相对位置。 控制器动态地选择与移动设备位置相对应的音频输出（a）阵列麦克风信号，或（b）来自移动设备的回声消除的麦克风信号。

公开(公告)号：US20150201278A1

公开(公告)日：2015-07-16

申请号：US14154975

申请日：2014-01-14

Applicant: CISCO TECHNOLOGY, INC.

Inventor： Feng Bao ,  Subrahmanyam Kunapuli ,  Fei Yang ,  Tor Sundsbarm

IPC: H04R3/00 ,  H04R3/04

CPC classification number: H04R3/005 ,  H04M3/568 ,  H04M2203/509 ,  H04N7/15

Abstract: A processing system can include tracking microphone array(s), audio-tracking circuitry configured to detect a location of audio sources from audio signals from the array(s), and processing circuitry. The processing circuitry can be configured to: identify a first microphone that has a strongest signal strength; estimate a location of an active speaker based on at least an output of the audio-tracking circuitry; determine whether a second microphone for the active speaker is affected by an acoustic obstacle based on the location of the active speaker and a location of the first microphone that has the strongest signal strength; estimate attenuation for microphones based on a comparison of actual signal strengths of the microphones with estimated signal strengths of the microphones that are estimated based on microphone signals of the second microphone for the active speaker; and modify the attenuation based on an estimated location of the acoustic obstacle.

Abstract translation: 处理系统可以包括跟踪麦克风阵列，被配置为从来自阵列的音频信号和处理电路检测音频源的位置的音频跟踪电路。 处理电路可以被配置为：识别具有最强信号强度的第一麦克风; 至少基于音频跟踪电路的输出来估计有源扬声器的位置; 基于有源扬声器的位置和具有最强信号强度的第一麦克风的位置，确定主动扬声器的第二麦克风是否受到声学障碍物的影响; 基于麦克风的实际信号强度与基于用于主动扬声器的第二麦克风的麦克风信号估计的麦克风的估计信号强度进行比较来估计麦克风的衰减; 并且基于声学障碍物的估计位置来修改衰减。

公开(公告)号：US09549079B2

公开(公告)日：2017-01-17

申请号：US14018635

申请日：2013-09-05

Applicant: Cisco Technology, Inc.

Inventor： Feng Bao ,  Subrahmanyam Venkata Kunapuli ,  Fei Yang ,  Xiangyu Bao ,  Tor A. Sundsbarm

IPC: H04M9/08 ,  G10K11/34

CPC classification number: H04M9/082 ,  G10K11/346

Abstract: Acoustic echo cancellation is improved by receiving a speaker signal that is used to produce audio in a room, and receiving audio signals that capture audio from an array of microphones in the room, including an acoustic echo from the speakers. To cancel the acoustic echo, one adaptive filter is associated with a corresponding subspace in the room. Each of the audio signals is assigned to at least one of the adaptive filters, and a set of coefficients is iteratively determined for each of the adaptive filters. The coefficients for an adaptive filter are determined by selecting each of the audio signals assigned to that adaptive filter and adapting the filter to remove an acoustic echo from each of the selected audio signals. At each iteration, a different audio signal is selected from the audio signals assigned to the adaptive filter in order to determine the set of coefficients.

Abstract translation: 通过接收用于在房间中产生音频的扬声器信号以及接收从房间中的麦克风阵列捕获音频的音频信号（包括来自扬声器的声学回声）来改善声学回声消除。 为了消除声学回声，一个自适应滤波器与房间中相应的子空间相关联。 每个音频信号被分配给至少一个自适应滤波器，并且针对每个自适应滤波器迭代地确定一组系数。 用于自适应滤波器的系数通过选择分配给该自适应滤波器的每个音频信号并且适配滤波器以从每个所选择的音频信号中去除声学回声来确定。 在每次迭代中，从分配给自适应滤波器的音频信号中选择不同的音频信号，以便确定该系数集合。