公开(公告)号：US20240005617A1

公开(公告)日：2024-01-04

申请号：US17855179

申请日：2022-06-30

Applicant: Snap Inc.

Inventor： Vladislav Shakhrai ,  Sergey Demyanov ,  Mikhail Vasilkovskii ,  Aleksei Stoliar

IPC: G06T19/20 ,  G06T11/00 ,  G06T17/20 ,  G06T7/40

CPC classification number: G06T19/20 ,  G06T11/001 ,  G06T17/20 ,  G06T7/40 ,  G06T2219/2016 ,  G06T2210/12 ,  G06T2210/22 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Methods and systems are disclosed for performing operations for generating a photorealistic rendering of an object. The operations include: accessing a set of albedo textures and a machine learning model associated with a real-world object, the set of albedo textures and a machine learning model having been trained based on a plurality of viewpoints of the real-world object; obtaining a three-dimensional (3D) mesh of the real-world object; receiving input that selects a new viewpoint that differs from the plurality of viewpoints of the real-world object; and generating a photorealistic rendering of the real-world object from the new viewpoint based on the 3D mesh of the real-world object, the set of albedo textures, and the machine learning model associated with the real-world object.

公开(公告)号：US20240296645A1

公开(公告)日：2024-09-05

申请号：US18664596

申请日：2024-05-15

Applicant: Snap Inc.

Inventor： Vladislav Shakhrai ,  Sergey Demyanov ,  Mikhail Vasilkovskii ,  Aleksei Stoliar

IPC: G06T19/20 ,  G06T7/40 ,  G06T11/00 ,  G06T17/20

CPC classification number: G06T19/20 ,  G06T7/40 ,  G06T11/001 ,  G06T17/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2210/12 ,  G06T2210/22 ,  G06T2219/2016

Abstract: Methods and systems are disclosed for performing operations for generating a photorealistic rendering of an object. The operations include: accessing a set of albedo textures and a machine learning model associated with a real-world object, the set of albedo textures and a machine learning model having been trained based on a plurality of viewpoints of the real-world object; obtaining a three-dimensional (3D) mesh of the real-world object; receiving input that selects a new viewpoint that differs from the plurality of viewpoints of the real-world object; and generating a photorealistic rendering of the real-world object from the new viewpoint based on the 3D mesh of the real-world object, the set of albedo textures, and the machine learning model associated with the real-world object.

公开(公告)号：US12020392B2

公开(公告)日：2024-06-25

申请号：US17855179

申请日：2022-06-30

Applicant: Snap Inc.

Inventor： Vladislav Shakhrai ,  Sergey Demyanov ,  Mikhail Vasilkovskii ,  Aleksei Stoliar

IPC: G06T19/00 ,  G06T7/40 ,  G06T11/00 ,  G06T17/20 ,  G06T19/20

CPC classification number: G06T19/20 ,  G06T7/40 ,  G06T11/001 ,  G06T17/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2210/12 ,  G06T2210/22 ,  G06T2219/2016

Abstract: Methods and systems are disclosed for performing operations for generating a photorealistic rendering of an object. The operations include: accessing a set of albedo textures and a machine learning model associated with a real-world object, the set of albedo textures and a machine learning model having been trained based on a plurality of viewpoints of the real-world object; obtaining a three-dimensional (3D) mesh of the real-world object; receiving input that selects a new viewpoint that differs from the plurality of viewpoints of the real-world object; and generating a photorealistic rendering of the real-world object from the new viewpoint based on the 3D mesh of the real-world object, the set of albedo textures, and the machine learning model associated with the real-world object.