-
公开(公告)号:US11543892B2
公开(公告)日:2023-01-03
申请号:US17302258
申请日:2021-04-28
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Shahram Izadi , Shwetak N. Patel
Abstract: A computing device, such as a wearable device, may include at least two electrodes mounted on a body. The computing device may determine an electrical signal associated with a circuit that includes the at least two electrodes and the user. A pressure applied to at least one electrode of the at least two electrodes may be determined from the electrical signal, and at least one function of the computing device may be implemented, based on the pressure.
-
公开(公告)号:US20220065620A1
公开(公告)日:2022-03-03
申请号:US17413847
申请日:2020-11-11
Applicant: GOOGLE LLC
Inventor: Sean Ryan Francesco Fanello , Kaiwen Guo , Peter Christopher Lincoln , Philip Lindsley Davidson , Jessica L. Busch , Xueming Yu , Geoffrey Harvey , Sergio Orts Escolano , Rohit Kumar Pandey , Jason Dourgarian , Danhang Tang , Adarsh Prakash Murthy Kowdle , Emily B. Cooper , Mingsong Dou , Graham Fyffe , Christoph Rhemann , Jonathan James Taylor , Shahram Izadi , Paul Ernest Debevec
IPC: G01B11/25 , G06T15/50 , G01B11/245 , G06T17/20
Abstract: A lighting stage includes a plurality of lights that project alternating spherical color gradient illumination patterns onto an object or human performer at a predetermined frequency. The lighting stage also includes a plurality of cameras that capture images of an object or human performer corresponding to the alternating spherical color gradient illumination patterns. The lighting stage also includes a plurality of depth sensors that capture depth maps of the object or human performer at the predetermined frequency. The lighting stage also includes (or is associated with) one or more processors that implement a machine learning algorithm to produce a three-dimensional (3D) model of the object or human performer. The 3D model includes relighting parameters used to relight the 3D model under different lighting conditions.
-
公开(公告)号:US11030773B2
公开(公告)日:2021-06-08
申请号:US16798881
申请日:2020-02-24
Applicant: Google LLC
Inventor: Jonathan James Taylor , Vladimir Tankovich , Danhang Tang , Cem Keskin , Adarsh Prakash Murthy Kowdle , Philip L. Davidson , Shahram Izadi , David Kim
Abstract: An electronic device estimates a pose of a hand by volumetrically deforming a signed distance field using a skinned tetrahedral mesh to locate a local minimum of an energy function, wherein the local minimum corresponds to the hand pose. The electronic device identifies a pose of the hand by fitting an implicit surface model of a hand to the pixels of a depth image that correspond to the hand. The electronic device uses a skinned tetrahedral mesh to warp space from a base pose to a deformed pose to define an articulated signed distance field from which the hand tracking module derives candidate poses of the hand. The electronic device then minimizes an energy function based on the distance of each corresponding pixel to identify the candidate pose that most closely approximates the pose of the hand.
-
公开(公告)号:US10937182B2
公开(公告)日:2021-03-02
申请号:US15994471
申请日:2018-05-31
Applicant: Google LLC
Inventor: Mingsong Dou , Sean Ryan Fanello , Adarsh Prakash Murthy Kowdle , Christoph Rhemann , Sameh Khamis , Philip L. Davidson , Shahram Izadi , Vladimir Tankovich
Abstract: An electronic device estimates a pose of one or more subjects in an environment based on estimating a correspondence between a data volume containing a data mesh based on a current frame captured by a depth camera and a reference volume containing a plurality of fused prior data frames based on spectral embedding and performing bidirectional non-rigid matching between the reference volume and the current data frame to refine the correspondence so as to support location-based functionality. The electronic device predicts correspondences between the data volume and the reference volume based on spectral embedding. The correspondences provide constraints that accelerate the convergence between the data volume and the reference volume. By tracking changes between the current data mesh frame and the reference volume, the electronic device avoids tracking failures that can occur when relying solely on a previous data mesh frame.
-
公开(公告)号:US20200349772A1
公开(公告)日:2020-11-05
申请号:US16861530
申请日:2020-04-29
Applicant: Google LLC
Inventor: Anastasia Tkach , Ricardo Martin Brualla , Shahram Izadi , Shuoran Yang , Cem Keskin , Sean Ryan Francesco Fanello , Philip Davidson , Jonathan Taylor , Rohit Pandey , Andrea Tagliasacchi , Pavlo Pidlypenskyi
Abstract: A method includes receiving a first image including color data and depth data, determining a viewpoint associated with an augmented reality (AR) and/or virtual reality (VR) display displaying a second image, receiving at least one calibration image including an object in the first image, the object being in a different pose as compared to a pose of the object in the first image, and generating the second image based on the first image, the viewpoint and the at least one calibration image.
-
16.
公开(公告)号:US20240338084A1
公开(公告)日:2024-10-10
申请号:US18440605
申请日:2024-02-13
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Andrea Colaco , Stiven Guillaume Francois Morvan , Adam James Banfield , Shahram Izadi
CPC classification number: G06F3/017 , G06F1/163 , G06V10/82 , G06V20/20 , G06V40/1318 , G06V40/15 , G06V40/28
Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.
-
公开(公告)号:US11335023B2
公开(公告)日:2022-05-17
申请号:US15929811
申请日:2020-05-22
Applicant: Google LLC
Inventor: Sameh Khamis , Christian Haene , Hossam Isack , Cem Keskin , Sofien Bouaziz , Shahram Izadi
Abstract: According to an aspect, a method for pose estimation using a convolutional neural network includes extracting features from an image, downsampling the features to a lower resolution, arranging the features into sets of features, where each set of features corresponds to a separate keypoint of a pose of a subject, updating, by at least one convolutional block, each set of features based on features of one or more neighboring keypoints using a kinematic structure, and predicting the pose of the subject using the updated sets of features.
-
公开(公告)号:US20210366146A1
公开(公告)日:2021-11-25
申请号:US15929811
申请日:2020-05-22
Applicant: Google LLC
Inventor: Sameh Khamis , Christian Haene , Hossam Isack , Cem Keskin , Sofien Bouaziz , Shahram Izadi
Abstract: According to an aspect, a method for pose estimation using a convolutional neural network includes extracting features from an image, downsampling the features to a lower resolution, arranging the features into sets of features, where each set of features corresponds to a separate keypoint of a pose of a subject, updating, by at least one convolutional block, each set of features based on features of one or more neighboring keypoints using a kinematic structure, and predicting the pose of the subject using the updated sets of features.
-
公开(公告)号:US20210365777A1
公开(公告)日:2021-11-25
申请号:US16976805
申请日:2019-07-23
Applicant: Google LLC
Inventor: Shahram Izadi , Cem Keskin
Abstract: Methods, systems, and apparatus for more efficiently and accurately generating neural network outputs, for instance, for use in classifying image or audio data. In one aspect, a method includes processing a network input using a neural network including multiple neural network layers to generate a network output. One or more of the neural network layers is a conditional neural network layer. Processing a layer input using a conditional neural network layer to generate a layer output includes obtaining values of one or more decision parameters of the conditional neural network layer. The neural network processes the layer input and the decision parameters of the conditional neural network layer to determine values of one or more latent parameters of the conditional neural network layer from a continuous set of possible latent parameter values. The values of the latent parameters specify the values of the conditional layer weights.
-
公开(公告)号:US10824226B2
公开(公告)日:2020-11-03
申请号:US16002595
申请日:2018-06-07
Applicant: Google LLC
Abstract: An electronic device estimates a pose of a face by fitting a generative face model mesh to a depth map based on vertices of the face model mesh that are estimated to be visible from the point of view of a depth camera. A face tracking module of the electronic device receives a depth image of a face from a depth camera and generates a depth map of the face based on the depth image. The face tracking module identifies a pose of the face by fitting a face model mesh to the pixels of a depth map that correspond to the vertices of the face model mesh that are estimated to be visible from the point of view of the depth camera.
-
-
-
-
-
-
-
-
-