公开(公告)号：US10073518B2

公开(公告)日：2018-09-11

申请号：US14162727

申请日：2014-01-23

Applicant: QUALCOMM Incorporated

Inventor： Md Sazzadur Rahman ,  Kexi Liu ,  Martin H. Renschler

IPC: G06F3/01 ,  G02B27/01 ,  G06T19/00

CPC classification number: G06F3/013 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F1/163 ,  G06F3/011 ,  G06F3/016 ,  G06F3/0304 ,  G06T19/006

Abstract: An apparatus for calibrating an eye tracking system of a head mounted display displays a moving object in a scene visible through the head mounted display. The object is displayed progressively at a plurality of different points (P) at corresponding different times (T). While the object is at a first point of the plurality of different points in time, the apparatus determines whether an offset between the point P and an eye gaze point (E) satisfies a threshold. The eye-gaze point (E) corresponds to a point where a user is determined to be gazing by the eye tracking system. If the threshold is not satisfied, the apparatus performs a calibration of the eye tracking system when the object is at a second point of the plurality of different points in time. The apparatus then repeats the determining step when the object is at a third point of the plurality of different points in time.

公开(公告)号：US20140136981A1

公开(公告)日：2014-05-15

申请号：US13725973

申请日：2012-12-21

Applicant: QUALCOMM INCORPORATED

Inventor： Pei Xiang ,  Kexi Liu

IPC: G06F3/16

CPC classification number: G10L17/00 ,  G06F3/0485 ,  G06F3/167 ,  G10H2210/301 ,  G10H2220/096 ,  G10H2220/355 ,  H04R3/005 ,  H04R29/002 ,  H04S7/303 ,  H04S7/40

Abstract: Methods and apparatuses for providing tangible control of sound are provided and described as embodied in a system that includes a sound transducer array along with a touch surface-enabled display table. The array may include a group of transducers (multiple speakers and/or microphones) configured to perform spatial processing of signals for the group of transducers so that sound rendering (in configurations where the array includes multiple speakers), or sound pick-up (in configurations where the array includes multiple microphones), have spatial patterns (or sound projection patterns) that are focused in certain directions while reducing disturbances from other directions. Users may directly adjust parameters related to sound projection patterns by interacting with the touch surface while receiving visual feedback by exercising one or more commands on the touch surface. The commands may be adjusted according to visual feedback received from the change of the display on the touch surface.

Abstract translation: 提供和描述用于提供有形声音控制的方法和装置，其体现在包括具有触摸表面的显示表的声音换能器阵列的系统中。 阵列可以包括一组换能器（多个扬声器和/或麦克风），其被配置为对该组换能器执行信号的空间处理，使得声音渲染（在阵列包括多个扬声器的配置中）或声音拾取（在 阵列包括多个麦克风的配置）具有在某些方向上聚焦的空间图案（或声音投影图案），同时减少来自其它方向的干扰。 用户可以通过与触摸表面交互来直接调整与声音投影图案相关的参数，同时通过在触摸表面上执行一个或多个命令来接收视觉反馈。 命令可以根据从触摸表面上的显示改变接收到的视觉反馈进行调整。

公开(公告)号：US20140136203A1

公开(公告)日：2014-05-15

申请号：US13725938

申请日：2012-12-21

Applicant: QUALCOMM INCORPORATED

Inventor： Kexi Liu ,  Pei Xiang

IPC: G10L17/00

CPC classification number: G10L17/00 ,  G06F3/0485 ,  G06F3/167 ,  G10H2210/301 ,  G10H2220/096 ,  G10H2220/355 ,  H04R3/005 ,  H04R29/002 ,  H04S7/303 ,  H04S7/40

Abstract: Some implementations provide a method for identifying a speaker. The method determines position and orientation of a second device based on data from a first device that is for capturing the position and orientation of the second device. The second device includes several microphones for capturing sound. The second device has movable position and movable orientation. The method assigns an object as a representation of a known user. The object has a moveable position. The method receives a position of the object. The position of the object corresponds to a position of the known user. The method processes the captured sound to identify a sound originating from the direction of the object. The direction of the object is relative to the position and the orientation of the second device. The method identifies the sound originating from the direction of the object as belonging to the known user.

Abstract translation: 一些实施方式提供了用于识别扬声器的方法。 该方法基于来自用于捕获第二设备的位置和取向的第一设备的数据来确定第二设备的位置和方向。 第二个设备包括几个用于捕获声音的麦克风。 第二装置具有可移动位置和可移动取向。 该方法将对象分配为已知用户的表示。 物体具有可移动的位置。 该方法接收对象的位置。 对象的位置对应于已知用户的位置。 该方法处理捕获的声音以识别从对象的方向产生的声音。 物体的方向相对于第二装置的位置和方向。 该方法将从对象的方向产生的声音标识为属于已知用户。

公开(公告)号：US11366515B2

公开(公告)日：2022-06-21

申请号：US16421103

申请日：2019-05-23

Applicant: QUALCOMM Incorporated

Inventor： Kexi Liu ,  Frederick D. Kim ,  Martin H. Renschler

IPC: G06F3/01 ,  G06F3/04815 ,  G06T19/00 ,  G02B27/01

Abstract: An apparatus, a method, and a computer program product are provided. The apparatus detects an eye gaze on a first region in a real world scene, sets a boundary that surrounds the first region, the boundary excluding at least a second region in the real world scene, performs an object recognition procedure on the first region within the boundary, and refrains from performing an object recognition procedure on the at least the second region.

公开(公告)号：US10914951B2

公开(公告)日：2021-02-09

申请号：US14162668

申请日：2014-01-23

Applicant: QUALCOMM Incorporated

Inventor： Kexi Liu ,  Vijay Naicker Subramaniam ,  Md Sazzadur Rahman ,  Martin H. Renschler

IPC: G02B27/01 ,  G06F3/01 ,  G06T19/00 ,  G06F3/03 ,  G06K9/00

Abstract: A method, an apparatus, and a computer program product provide feedback to a user of an augmented reality (AR) device having an optical see-through head mounted display (HMD). The apparatus obtains a location on the HMD corresponding to a user interaction with an object displayed on the HMD. The object may be an icon on the HMD and the user interaction may be an attempt by the user to select the icon through an eye gaze or gesture. The apparatus determines whether a spatial relationship between the location of user interaction and the object satisfies a criterion, and outputs a sensory indication, e.g., visual display, sound, vibration, when the criterion is satisfied. The apparatus may be configured to output a sensory indication when user interaction is successful, e.g., the icon was selected. Alternatively, the apparatus may be configured to output a sensory indication when the user interaction fails.

公开(公告)号：US10394330B2

公开(公告)日：2019-08-27

申请号：US14203063

申请日：2014-03-10

Applicant: QUALCOMM Incorporated

Inventor： Jill Sayuri Iwasaki ,  Bennett Michael King ,  Kexi Liu ,  Martin Hans Renschler

IPC: G06F3/01 ,  G06F1/16 ,  H04M1/725

Abstract: Access terminals are adapted to facilitate automated wireless communication interactions based on implicit user cues. According to one example, an access terminal can obtain a plurality of user cues, including user cues from at least two primary sensor inputs, as well as other optional user cues. The access terminal may identify the occurrence of a predefined combination of user cues from among the plurality of user cues. In response to the identification of the predefined combination of user cues, the access terminal may affect a wireless communication link with an access terminal associated with another user. Other aspects, embodiments, and features are also included.

公开(公告)号：US09412375B2

公开(公告)日：2016-08-09

申请号：US13725951

申请日：2012-12-21

Applicant: QUALCOMM Incorporated

Inventor： Pei Xiang ,  Kexi Liu

IPC: H04R29/00 ,  G10L17/00 ,  G06F3/16 ,  H04R3/00 ,  H04S7/00

CPC classification number: G10L17/00 ,  G06F3/0485 ,  G06F3/167 ,  G10H2210/301 ,  G10H2220/096 ,  G10H2220/355 ,  H04R3/005 ,  H04R29/002 ,  H04S7/303 ,  H04S7/40

Abstract: Methods and apparatuses for representing a sound field in a physical space are provided and described as embodied in a system that includes a sound transducer array along with a touch surface-enabled display table. The array may include a group of transducers (multiple speakers and/or microphones). The array may be configured to perform spatial processing of signals for the group of transducers so that sound rendering (in configurations where the array includes multiple speakers), or sound pick-up (in configurations where the array includes multiple microphones), may have spatial patterns (or sound projection patterns) that are focused in certain directions while reducing disturbances from other directions.

Abstract translation: 用于在物理空间中表示声场的方法和装置被提供和描述为具有包括具有触摸表面的显示表的声音换能器阵列的系统。 阵列可以包括一组换能器（多个扬声器和/或麦克风）。 该阵列可以被配置为执行用于该组换能器的信号的空间处理，使得声音渲染（在阵列包括多个扬声器的配置中）或声音拾取（在阵列包括多个麦克风的配置中）可以具有空间 在某些方向上聚焦的图案（或声音投影图案），同时减少来自其他方向的干扰。

公开(公告)号：US20140133665A1

公开(公告)日：2014-05-15

申请号：US13725951

申请日：2012-12-21

Applicant: QUALCOMM INCORPORATED

Inventor： Pei Xiang ,  Kexi Liu

IPC: H04R29/00

CPC classification number: G10L17/00 ,  G06F3/0485 ,  G06F3/167 ,  G10H2210/301 ,  G10H2220/096 ,  G10H2220/355 ,  H04R3/005 ,  H04R29/002 ,  H04S7/303 ,  H04S7/40

Abstract: Methods and apparatuses for representing a sound field in a physical space are provided and described as embodied in a system that includes a sound transducer array along with a touch surface-enabled display table. The array may include a group of transducers (multiple speakers and/or microphones). The array may be configured to perform spatial processing of signals for the group of transducers so that sound rendering (in configurations where the array includes multiple speakers), or sound pick-up (in configurations where the array includes multiple microphones), may have spatial patterns (or sound projection patterns) that are focused in certain directions while reducing disturbances from other directions.

Abstract translation: 用于在物理空间中表示声场的方法和装置被提供和描述为具有包括具有触摸表面的显示表的声音换能器阵列的系统。 阵列可以包括一组换能器（多个扬声器和/或麦克风）。 该阵列可以被配置为执行用于该组换能器的信号的空间处理，使得声音渲染（在阵列包括多个扬声器的配置中）或声音拾取（在阵列包括多个麦克风的配置中）可以具有空间 在某些方向上聚焦的图案（或声音投影图案），同时减少来自其他方向的干扰。