公开(公告)号：US20240126810A1

公开(公告)日：2024-04-18

申请号：US18391262

申请日：2023-12-20

Applicant: Google LLC

Inventor： Janne KONTKANEN ,  Jamie Aspinall ,  Dominik Kaeser ,  Navin Sarma ,  Brian Curless ,  David Salesin

IPC: G06F16/738 ,  G06F16/75 ,  G06F16/78 ,  G06N20/00 ,  G06T7/20 ,  H04N5/262

CPC classification number: G06F16/739 ,  G06F16/75 ,  G06F16/7867 ,  G06N20/00 ,  G06T7/20 ,  H04N5/2628

Abstract: A media application selects, from a collection of images associated with a user account, candidate pairs of images, where each pair includes a first static image and a second static image from the user account. The media application applies a filter to select a particular pair of images from the candidate pairs of images. The media application generates, using an image interpolator, one or more intermediate images based on the particular pair of images. The media application generates a video that includes three or more frames arranged in a sequence, where a first frame of the sequence is the first static image, a last frame of the sequence is the second static image, and each of the one or more intermediate images is a corresponding intermediate frame of the sequence between the first frame and the last frame.

公开(公告)号：US12265574B2

公开(公告)日：2025-04-01

申请号：US18391262

申请日：2023-12-20

Applicant: Google LLC

Inventor： Janne Kontkanen ,  Jamie Aspinall ,  Dominik Kaeser ,  Navin Sarma ,  Brian Curless ,  David Salesin

IPC: G06F16/75 ,  G06F16/738 ,  G06F16/78 ,  G06N20/00 ,  G06T7/20 ,  H04N5/262

Abstract: A media application selects, from a collection of images associated with a user account, candidate pairs of images, where each pair includes a first static image and a second static image from the user account. The media application applies a filter to select a particular pair of images from the candidate pairs of images. The media application generates, using an image interpolator, one or more intermediate images based on the particular pair of images. The media application generates a video that includes three or more frames arranged in a sequence, where a first frame of the sequence is the first static image, a last frame of the sequence is the second static image, and each of the one or more intermediate images is a corresponding intermediate frame of the sequence between the first frame and the last frame.

公开(公告)号：US11468604B2

公开(公告)日：2022-10-11

申请号：US16451526

申请日：2019-06-25

Applicant: Google LLC

Inventor： Robert Carl Jagnow ,  Joanna Kim ,  Catherine Most ,  Andre Quang Le ,  Alex Jacobo-Blonder ,  Kasey Klimes ,  Dominik Kaeser ,  Rachel Elizabeth Inman

IPC: G06T11/00 ,  G06T7/20 ,  G08B21/02 ,  H04L67/55

Abstract: The present disclosure is directed to providing a notification in association with an augmented reality (AR) view. In particular, one or more computing devices can generate, for display by at least one of the computing device(s), an interface depicting an AR view of at least a portion of a physical real-world environment. In accordance with aspects of the disclosure, based at least in part on detected movement of the at least one of the computing device(s), the computing device(s) can transition amongst multiple different stages of one or more elements included in the interface to notify a viewer of the interface to mind their situational awareness of the physical real-world environment.

公开(公告)号：US12260572B2

公开(公告)日：2025-03-25

申请号：US17907529

申请日：2021-08-05

Applicant: Google LLC

Inventor： Varun Jampani ,  Huiwen Chang ,  Kyle Sargent ,  Abhishek Kar ,  Richard Tucker ,  Dominik Kaeser ,  Brian L. Curless ,  David Salesin ,  William T. Freeman ,  Michael Krainin ,  Ce Liu

IPC: G06T7/00 ,  G06T5/60 ,  G06T5/77 ,  G06T7/50

Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.

公开(公告)号：US20240249422A1

公开(公告)日：2024-07-25

申请号：US17907529

申请日：2021-08-05

Applicant: Google LLC

Inventor： Varun Jampani ,  Huiwen Chang ,  Kyle Sargent ,  Abhishek Kar ,  Richard Tucker ,  Dominik Kaeser ,  Brian L. Curless ,  David Salesin ,  William T. Freeman ,  Michael Krainin ,  Ce Liu

IPC: G06T7/50 ,  G06T5/60 ,  G06T5/77

CPC classification number: G06T7/50 ,  G06T5/60 ,  G06T5/77 ,  G06T2207/20081

Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.

公开(公告)号：US11893056B2

公开(公告)日：2024-02-06

申请号：US17566462

申请日：2021-12-30

Applicant: Google LLC

Inventor： Janne Kontkanen ,  Jamie Aspinall ,  Dominik Kaeser ,  Navin Sarma ,  Brian Curless ,  David Salesin

IPC: G06F16/75 ,  G06T7/20 ,  G06F16/738 ,  G06N20/00 ,  G06F16/78 ,  H04N5/262

CPC classification number: G06F16/739 ,  G06F16/75 ,  G06F16/7867 ,  G06N20/00 ,  G06T7/20 ,  H04N5/2628

Abstract: A media application selects, from a collection of images associated with a user account, candidate pairs of images, where each pair includes a first static image and a second static image from the user account. The media application applies a filter to select a particular pair of images from the candidate pairs of images. The media application generates, using an image interpolator, one or more intermediate images based on the particular pair of images. The media application generates a video that includes three or more frames arranged in a sequence, where a first frame of the sequence is the first static image, a last frame of the sequence is the second static image, and each of the one or more intermediate images is a corresponding intermediate frame of the sequence between the first frame and the last frame.