公开(公告)号：US20240005617A1

公开(公告)日：2024-01-04

申请号：US17855179

申请日：2022-06-30

Applicant: Snap Inc.

Inventor： Vladislav Shakhrai ,  Sergey Demyanov ,  Mikhail Vasilkovskii ,  Aleksei Stoliar

IPC: G06T19/20 ,  G06T11/00 ,  G06T17/20 ,  G06T7/40

CPC classification number: G06T19/20 ,  G06T11/001 ,  G06T17/20 ,  G06T7/40 ,  G06T2219/2016 ,  G06T2210/12 ,  G06T2210/22 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Methods and systems are disclosed for performing operations for generating a photorealistic rendering of an object. The operations include: accessing a set of albedo textures and a machine learning model associated with a real-world object, the set of albedo textures and a machine learning model having been trained based on a plurality of viewpoints of the real-world object; obtaining a three-dimensional (3D) mesh of the real-world object; receiving input that selects a new viewpoint that differs from the plurality of viewpoints of the real-world object; and generating a photorealistic rendering of the real-world object from the new viewpoint based on the 3D mesh of the real-world object, the set of albedo textures, and the machine learning model associated with the real-world object.

公开(公告)号：US20240296645A1

公开(公告)日：2024-09-05

申请号：US18664596

申请日：2024-05-15

Applicant: Snap Inc.

Inventor： Vladislav Shakhrai ,  Sergey Demyanov ,  Mikhail Vasilkovskii ,  Aleksei Stoliar

IPC: G06T19/20 ,  G06T7/40 ,  G06T11/00 ,  G06T17/20

CPC classification number: G06T19/20 ,  G06T7/40 ,  G06T11/001 ,  G06T17/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2210/12 ,  G06T2210/22 ,  G06T2219/2016

Abstract: Methods and systems are disclosed for performing operations for generating a photorealistic rendering of an object. The operations include: accessing a set of albedo textures and a machine learning model associated with a real-world object, the set of albedo textures and a machine learning model having been trained based on a plurality of viewpoints of the real-world object; obtaining a three-dimensional (3D) mesh of the real-world object; receiving input that selects a new viewpoint that differs from the plurality of viewpoints of the real-world object; and generating a photorealistic rendering of the real-world object from the new viewpoint based on the 3D mesh of the real-world object, the set of albedo textures, and the machine learning model associated with the real-world object.

公开(公告)号：US12020392B2

公开(公告)日：2024-06-25

申请号：US17855179

申请日：2022-06-30

Applicant: Snap Inc.

Inventor： Vladislav Shakhrai ,  Sergey Demyanov ,  Mikhail Vasilkovskii ,  Aleksei Stoliar

IPC: G06T19/00 ,  G06T7/40 ,  G06T11/00 ,  G06T17/20 ,  G06T19/20

CPC classification number: G06T19/20 ,  G06T7/40 ,  G06T11/001 ,  G06T17/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2210/12 ,  G06T2210/22 ,  G06T2219/2016

Abstract: Methods and systems are disclosed for performing operations for generating a photorealistic rendering of an object. The operations include: accessing a set of albedo textures and a machine learning model associated with a real-world object, the set of albedo textures and a machine learning model having been trained based on a plurality of viewpoints of the real-world object; obtaining a three-dimensional (3D) mesh of the real-world object; receiving input that selects a new viewpoint that differs from the plurality of viewpoints of the real-world object; and generating a photorealistic rendering of the real-world object from the new viewpoint based on the 3D mesh of the real-world object, the set of albedo textures, and the machine learning model associated with the real-world object.

公开(公告)号：US20240303902A1

公开(公告)日：2024-09-12

申请号：US18182117

申请日：2023-03-10

Applicant: SNAP INC.

Inventor： Vladislav Shakhrai ,  Sergey Demyanov ,  Aleksei Stoliar ,  Istvan Marton

IPC: G06T15/04 ,  G06T15/00

CPC classification number: G06T15/04 ,  G06T15/005

Abstract: The subject technology receives an object mesh, information related to a viewpoint for rendering an image of an object having a reflective surface, and a set of maps. The subject technology generates a rasterized RGB (Red Green Blue) image based on the object mesh, the viewpoint, and the set of maps. The subject technology generates, using a neural network model, an output image of the object with the reflective surface based at least in part on the rasterized RGB image and the viewpoint. The subject technology provides for display the output image of the object with the reflective surface on a display of a computer client device.