公开(公告)号：US20230186438A1

公开(公告)日：2023-06-15

申请号：US17643552

申请日：2021-12-09

Applicant: Google LLC

Inventor： Hendrik Wagenaar ,  Alex Olwal

IPC: G06T5/00 ,  G06T9/00

CPC classification number: G06T5/006 ,  G06T9/00

Abstract: A method including receiving, by a companion device from an optical display, a distortion information associated with a geometric distortion associated with rendering an image on a display of the optical display, distorting, by the companion device, the image using the distortion information, preprocessing, by the companion device, the distorted image based on compression artifacts, compressing, by the companion device, the distorted image, and communicating, by the companion device, the compressed image to the optical display

公开(公告)号：US20230071778A1

公开(公告)日：2023-03-09

申请号：US17446877

申请日：2021-09-03

Applicant: Google LLC

Inventor： Ruofei Du ,  Hendrik Wagenaar ,  Alex Olwal

IPC: G10L21/10 ,  G06K9/00 ,  G06F3/01 ,  H04R3/00 ,  H04R1/40 ,  G06T7/70 ,  G10L15/26 ,  G10L15/22 ,  H04R1/08 ,  G10L15/25 ,  G10L21/18 ,  G06T7/50

Abstract: An augmented reality (AR) device, such as AR glasses, may include a microphone array. The sensitivity of the microphone array can be directed to a target by beamforming, which includes combining the audio of each microphone of the array in a particular way based on a location of the target. The present disclosure describes systems and methods to determine the location of the target based on a gaze of a user and beamform the audio accordingly. This eye-tracked beamforming (i.e., foveated beamforming) can be used by AR applications to enhance sounds from a gaze direction and to suppress sounds from other directions. Additionally, the gaze information can be used to help visualize the results of an AR application, such as speech-to-text.

公开(公告)号：US11967335B2

公开(公告)日：2024-04-23

申请号：US17446877

申请日：2021-09-03

Applicant: Google LLC

Inventor： Ruofei Du ,  Hendrik Wagenaar ,  Alex Olwal

IPC: G06F3/01 ,  G06T7/50 ,  G06T7/70 ,  G06V40/16 ,  G06V40/19 ,  G10L15/22 ,  G10L15/25 ,  G10L15/26 ,  G10L21/10 ,  G10L21/18 ,  H04R1/08 ,  H04R1/40 ,  H04R3/00

CPC classification number: G10L21/10 ,  G06F3/013 ,  G06T7/50 ,  G06T7/70 ,  G06V40/171 ,  G06V40/19 ,  G10L15/22 ,  G10L15/25 ,  G10L15/26 ,  G10L21/18 ,  H04R1/08 ,  H04R1/406 ,  H04R3/005 ,  G06T2207/30201 ,  H04R2201/401

Abstract: An augmented reality (AR) device, such as AR glasses, may include a microphone array. The sensitivity of the microphone array can be directed to a target by beamforming, which includes combining the audio of each microphone of the array in a particular way based on a location of the target. The present disclosure describes systems and methods to determine the location of the target based on a gaze of a user and beamform the audio accordingly. This eye-tracked beamforming (i.e., foveated beamforming) can be used by AR applications to enhance sounds from a gaze direction and to suppress sounds from other directions. Additionally, the gaze information can be used to help visualize the results of an AR application, such as speech-to-text.

公开(公告)号：US12026859B2

公开(公告)日：2024-07-02

申请号：US17643552

申请日：2021-12-09

Applicant: Google LLC

Inventor： Hendrik Wagenaar ,  Alex Olwal

IPC: G06T5/80 ,  G06T9/00

CPC classification number: G06T5/80 ,  G06T9/00

Abstract: A method including receiving, by a companion device from an optical display, a distortion information associated with a geometric distortion associated with rendering an image on a display of the optical display, distorting, by the companion device, the image using the distortion information, preprocessing, by the companion device, the distorted image based on compression artifacts, compressing, by the companion device, the distorted image, and communicating, by the companion device, the compressed image to the optical display