公开(公告)号：US20200099920A1

公开(公告)日：2020-03-26

申请号：US16580802

申请日：2019-09-24

Applicant: Google LLC

Inventor： Sameh KHAMIS ,  Yinda ZHANG ,  Christoph RHEMANN ,  Julien VALENTIN ,  Adarsh KOWDLE ,  Vladimir TANKOVICH ,  Michael SCHOENBERG ,  Shahram IZADI ,  Thomas FUNKHOUSER ,  Sean FANELLO

IPC: H04N13/271 ,  G06T7/90 ,  G06T7/521 ,  H04N5/33 ,  H04N13/239

Abstract: An electronic device estimates a depth map of an environment based on matching reduced-resolution stereo depth images captured by depth cameras to generate a coarse disparity (depth) map. The electronic device downsamples depth images captured by the depth cameras and matches sections of the reduced-resolution images to each other to generate a coarse depth map. The electronic device upsamples the coarse depth map to a higher resolution and refines the upsampled depth map to generate a high-resolution depth map to support location-based functionality.

公开(公告)号：US20230209036A1

公开(公告)日：2023-06-29

申请号：US18111292

申请日：2023-02-17

Applicant: GOOGLE LLC

Inventor： Sameh KHAMIS ,  Yinda ZHANG ,  Christoph RHEMANN ,  Julien VALENTIN ,  Adarsh KOWDLE ,  Vladimir TANKOVICH ,  Michael SCHOENBERG ,  Shahram IZADI ,  Thomas FUNKHOUSER ,  Sean FANELLO

IPC: H04N13/271 ,  G06T7/90 ,  G06T7/521 ,  H04N5/33 ,  H04N13/239

CPC classification number: H04N13/271 ,  G06T7/90 ,  G06T7/521 ,  H04N5/33 ,  H04N13/239 ,  G06T2207/10024 ,  G06T2207/10028

Abstract: An electronic device estimates a depth map of an environment based on matching reduced-resolution stereo depth images captured by depth cameras to generate a coarse disparity (depth) map. The electronic device downsamples depth images captured by the depth cameras and matches sections of the reduced-resolution images to each other to generate a coarse depth map. The electronic device upsamples the coarse depth map to a higher resolution and refines the upsampled depth map to generate a high-resolution depth map to support location-based functionality.

公开(公告)号：US20220343525A1

公开(公告)日：2022-10-27

申请号：US17640114

申请日：2020-04-27

Applicant: GOOGLE LLC

Inventor： Rahul GARG ,  Neal WADHWA ,  Sean FANELLO ,  Christian HAENE ,  Yinda ZHANG ,  Sergio Orts ESCOLANO ,  Yael Pritch KNAAN ,  Marc LEVOY ,  Shahram IZADI

IPC: G06T7/593 ,  G06T5/00

Abstract: Example implementations relate to joint depth prediction from dual cameras and dual pixels. An example method may involve obtaining a first set of depth information representing a scene from a first source and a second set of depth information representing the scene from a second source. The method may further involve determining, using a neural network, a joint depth map that conveys respective depths for elements in the scene. The neural network may determine the joint depth map based on a combination of the first set of depth information and the second set of depth information. In addition, the method may involve modifying an image representing the scene based on the joint depth map. For example, background portions of the image may be partially blurred based on the joint depth map.

公开(公告)号：US20220327769A1

公开(公告)日：2022-10-13

申请号：US17639967

申请日：2020-05-04

Applicant: GOOGLE LLC

Inventor： Yun-Ta TSAI ,  Xiuming ZHANG ,  Jonathan T. BARRON ,  Sean FANELLO ,  Tiancheng SUN ,  Tianfan XUE

IPC: G06T15/50 ,  G06T15/04 ,  G06T15/20 ,  G06N3/08

Abstract: Examples relate to implementations of a neural light transport. A computing system may obtain data indicative of a plurality of UV texture maps and a geometry of an object. Each UV texture map depicts the object from a perspective of a plurality of perspectives. The computing system may train a neural network to learn a light transport function using the data. The light transport function may be a continuous function that specifies how light interacts with the object when the object is viewed from the plurality of perspectives. The computing system may generate an output UV texture map that depicts the object from a synthesized perspective based on an application of the light transport function by the trained neural network.