公开(公告)号：US20240161406A1

公开(公告)日：2024-05-16

申请号：US18055590

申请日：2022-11-15

Applicant: Adobe Inc.

Inventor： Radomir Mech ,  Nathan Carr ,  Matheus Gadelha

IPC: G06T17/20 ,  G06T5/00

CPC classification number: G06T17/205 ,  G06T5/005 ,  G06T2207/20084

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating three-dimensional meshes representing two-dimensional images for editing the two-dimensional images. The disclosed system utilizes a first neural network to determine density values of pixels of a two-dimensional image based on estimated disparity. The disclosed system samples points in the two-dimensional image according to the density values and generates a tessellation based on the sampled points. The disclosed system utilizes a second neural network to estimate camera parameters and modify the three-dimensional mesh based on the estimated camera parameters of the pixels of the two-dimensional image. In one or more additional embodiments, the disclosed system generates a three-dimensional mesh to modify a two-dimensional image according to a displacement input. Specifically, the disclosed system maps the three-dimensional mesh to the two-dimensional image, modifies the three-dimensional mesh in response to a displacement input, and updates the two-dimensional image.

公开(公告)号：US20240161405A1

公开(公告)日：2024-05-16

申请号：US18055585

申请日：2022-11-15

Applicant: Adobe Inc.

Inventor： Radomir Mech ,  Nathan Carr ,  Matheus Gadelha

IPC: G06T17/20 ,  G06T7/11 ,  G06T7/50 ,  G06T7/70 ,  G06T11/60 ,  G06V20/70

CPC classification number: G06T17/205 ,  G06T7/11 ,  G06T7/50 ,  G06T7/70 ,  G06T11/60 ,  G06V20/70 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2207/20021 ,  G06T2207/20084 ,  G06T2207/20228

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating three-dimensional meshes representing two-dimensional images for editing the two-dimensional images. The disclosed system utilizes a first neural network to determine density values of pixels of a two-dimensional image based on estimated disparity. The disclosed system samples points in the two-dimensional image according to the density values and generates a tessellation based on the sampled points. The disclosed system utilizes a second neural network to estimate camera parameters and modify the three-dimensional mesh based on the estimated camera parameters of the pixels of the two-dimensional image. In one or more additional embodiments, the disclosed system generates a three-dimensional mesh to modify a two-dimensional image according to a displacement input. Specifically, the disclosed system maps the three-dimensional mesh to the two-dimensional image, modifies the three-dimensional mesh in response to a displacement input, and updates the two-dimensional image.

公开(公告)号：US20240135612A1

公开(公告)日：2024-04-25

申请号：US18304113

申请日：2023-04-20

Applicant: Adobe Inc.

Inventor： Yannick Hold-Geoffroy ,  Vojtech Krs ,  Radomir Mech ,  Nathan Carr ,  Matheus Gadelha

IPC: G06T11/60 ,  G06T7/194 ,  G06T7/50 ,  G06T7/68 ,  G06T15/60

CPC classification number: G06T11/60 ,  G06T7/194 ,  G06T7/50 ,  G06T7/68 ,  G06T15/60

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.