公开(公告)号：US11347320B1

公开(公告)日：2022-05-31

申请号：US17304986

申请日：2021-06-29

Applicant: Google LLC

Inventor： Dongeek Shin ,  David Kim ,  Sofien Bouaziz

IPC: G06F3/01 ,  G06F3/03

Abstract: A computing device, such as a wearable device, may include a gesture sensor that generates a gesture signal in response to a gesture of a user performed while the computing device is being worn or held by the user. A calibration sensor may generate a calibration signal characterizing a degree of tightness with which the computing device is being worn or held by the user. The gesture signal may be calibrated using the calibration signal, to obtain a calibrated gesture signal that is calibrated with respect to the degree of tightness. At least one function of the at least one computing device may be implemented, based on the calibrated gesture signal.

公开(公告)号：US12073028B2

公开(公告)日：2024-08-27

申请号：US18174358

申请日：2023-02-24

Applicant: GOOGLE LLC

Inventor： Dongeek Shin ,  Shahram Izadi ,  David Kim ,  Sofien Bouaziz ,  Steven Benjamin Goldberg ,  Ivan Poupyrev ,  Shwetak N. Patel

IPC: G06F3/01 ,  G06F1/16 ,  G06V40/20

CPC classification number: G06F3/017 ,  G06F1/163 ,  G06F3/014 ,  G06V40/28

Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.

公开(公告)号：US20240144523A1

公开(公告)日：2024-05-02

申请号：US18495483

申请日：2023-10-26

Applicant: GOOGLE LLC

Inventor： Ruofei Du ,  Ananta Narayanan Balaji ,  David Kim ,  Clayton Merrill Kimber

IPC: G06T7/73 ,  G06T7/80

CPC classification number: G06T7/73 ,  G06T7/80 ,  G06T2207/10012 ,  G06T2207/10048 ,  G06T2207/20084 ,  G06T2207/30204

Abstract: According to an aspect, a method may include receiving two-dimensional (2D) positions of at least one of a first reflective marker or a second reflective marker of a physical component, estimating a three-dimensional (3D) position of the first reflective marker and a 3D position of the second reflective marker based on the 2D positions, and computing an orientation of the physical component in 3D space based on the 3D position of the first reflective marker, the 3D position of the second reflective marker, and positioning information of the first and second reflective markers in the physical component.

公开(公告)号：US20230305672A1

公开(公告)日：2023-09-28

申请号：US17656818

申请日：2022-03-28

Applicant: Google LLC

Inventor： Ruofei Du ,  Alex Olwal ,  Mathieu Simon Le Goc ,  David Kim ,  Danhang Tang

IPC: G06F3/04815 ,  G10L15/22 ,  G02B27/01

CPC classification number: G06F3/04815 ,  G10L15/22 ,  G02B27/0172 ,  G02B27/0176 ,  G02B2027/0178 ,  G10L2015/223

Abstract: Systems and methods are provided in which physical objects in the ambient environment can function as user interface implements in an augmented reality environment. A physical object detected within a field of view of a camera of a computing device may be designated as a user interface implement in response to a user command. User interfaces may be attached to the designated physical object, to provide a tangible user interface implement for user interaction with the augmented reality environment.

公开(公告)号：US20220414834A1

公开(公告)日：2022-12-29

申请号：US17756700

申请日：2020-05-26

Applicant: Google LLC

Inventor： Ruofei Du ,  David Kim

IPC: G06T5/00 ,  G06T7/50 ,  G06T7/13

Abstract: A method including receiving an image as a portion of a real-world space, placing an anchor on the image, determining a position of the anchor, determine a depth associated with the position of the anchor, applying an image editing algorithm based on the depth to the captured image, and rendering the edited image.

公开(公告)号：US20230206567A1

公开(公告)日：2023-06-29

申请号：US17998736

申请日：2020-05-29

Applicant: GOOGLE LLC

Inventor： David Kim ,  Ruofei Du

IPC: G06T19/00 ,  G06T17/20 ,  G06T7/50 ,  G06T15/06 ,  G06T15/60

CPC classification number: G06T19/006 ,  G06T17/20 ,  G06T7/50 ,  G06T15/06 ,  G06T15/60 ,  G06T2207/10028 ,  G06T2200/28 ,  G06T2215/12 ,  G06T2215/16 ,  G06T2210/21

Abstract: Techniques of introducing virtual objects into a physical environment of AR system include displacing vertices of a mesh representing the physical environment based on a live depth map. For example, an AR system generates a mesh template, i.e., an initial mesh with vertices that represents a physical environment and a depth map that indicates a geometry of real objects within the physical environment. The AR system is configured to represent the real objects in the physical environment by displacing the vertices of the mesh based on depth values of the depth map and parameter values of a pinhole camera model. The depth values may be taken from the perspective of an illumination source in the physical environment.

公开(公告)号：US11592908B2

公开(公告)日：2023-02-28

申请号：US17249966

申请日：2021-03-19

Applicant: GOOGLE LLC

Inventor： Dongeek Shin ,  Shahram Izadi ,  David Kim ,  Sofien Bouaziz ,  Steven Benjamin Goldberg ,  Ivan Poupyrev ,  Shwetak N. Patel

IPC: G06F3/01 ,  G06F1/16 ,  G06V40/20

Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.