公开(公告)号：US12260572B2

公开(公告)日：2025-03-25

申请号：US17907529

申请日：2021-08-05

Applicant: Google LLC

Inventor： Varun Jampani ,  Huiwen Chang ,  Kyle Sargent ,  Abhishek Kar ,  Richard Tucker ,  Dominik Kaeser ,  Brian L. Curless ,  David Salesin ,  William T. Freeman ,  Michael Krainin ,  Ce Liu

IPC: G06T7/00 ,  G06T5/60 ,  G06T5/77 ,  G06T7/50

Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.

公开(公告)号：US20240249422A1

公开(公告)日：2024-07-25

申请号：US17907529

申请日：2021-08-05

Applicant: Google LLC

Inventor： Varun Jampani ,  Huiwen Chang ,  Kyle Sargent ,  Abhishek Kar ,  Richard Tucker ,  Dominik Kaeser ,  Brian L. Curless ,  David Salesin ,  William T. Freeman ,  Michael Krainin ,  Ce Liu

IPC: G06T7/50 ,  G06T5/60 ,  G06T5/77

CPC classification number: G06T7/50 ,  G06T5/60 ,  G06T5/77 ,  G06T2207/20081

Abstract: A method includes determining, based on an image having an initial viewpoint, a depth image, and determining a foreground visibility map including visibility values that are inversely proportional to a depth gradient of the depth image. The method also includes determining, based on the depth image, a background disocclusion mask indicating a likelihood that pixel of the image will be disoccluded by a viewpoint adjustment. The method additionally includes generating, based on the image, the depth image, and the background disocclusion mask, an inpainted image and an inpainted depth image. The method further includes generating, based on the depth image and the inpainted depth image, respectively, a first three-dimensional (3D) representation of the image and a second 3D representation of the inpainted image, and generating a modified image having an adjusted viewpoint by combining the first and second 3D representation based on the foreground visibility map.