公开(公告)号：US20230410438A1

公开(公告)日：2023-12-21

申请号：US17843573

申请日：2022-06-17

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: G06T19/00 ,  G06T5/00 ,  G06V10/82 ,  G06V20/20 ,  G06V10/774 ,  G06T5/20

CPC classification number: G06T19/006 ,  G06T5/002 ,  G06V10/82 ,  G06V20/20 ,  G06V10/774 ,  G06T5/20 ,  G06T2207/20084 ,  G06T2207/20081 ,  G06T2207/30201

Abstract: Systems and embodiments herein describe an augmented reality (AR) object rendering system. The AR object rendering system receives an image, generates a set of noise parameters and a set of blur parameters for the image using a neural network trained on a paired dataset of images, identifies an AR object associated with the image, modifies the AR object using the set of noise parameters and the set of blur parameters, displays the modified augmented reality object within the image.

公开(公告)号：US12299810B2

公开(公告)日：2025-05-13

申请号：US17846918

申请日：2022-06-22

Applicant: Snap Inc.

Inventor： Menglei Chai ,  Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: G06T15/50 ,  G06T15/80 ,  G06V10/774 ,  G06V10/82

Abstract: A method for applying lighting conditions to a virtual object in an augmented reality (AR) device is described. In one aspect, the method includes generating, using a camera of a mobile device, an image, accessing a virtual object corresponding to an object in the image, identifying lighting parameters of the virtual object based on a machine learning model that is pre-trained with a paired dataset, the paired dataset includes synthetic source data and synthetic target data, the synthetic source data includes environment maps and 3D scans of items depicted in the environment map, the synthetic target data includes a synthetic sphere image rendered in the same environment map, applying the lighting parameters to the virtual object, and displaying, in a display of the mobile device, the shaded virtual object as a layer to the image.

公开(公告)号：US20240246590A1

公开(公告)日：2024-07-25

申请号：US18625568

申请日：2024-04-03

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: B62B3/06 ,  A47B9/20 ,  A47B31/00 ,  B62B5/00 ,  B66F11/04

CPC classification number: B62B3/0618 ,  A47B9/20 ,  A47B31/00 ,  B62B5/0086 ,  B66F11/04 ,  B62B2202/30

Abstract: Systems and embodiments herein describe an augmented reality (AR) object rendering system. The AR object rendering system receives an image, generates a set of noise parameters and a set of blur parameters for the image using a neural network trained on a paired dataset of images, identifies an AR object associated with the image, modifies the AR object using the set of noise parameters and the set of blur parameters, displays the modified augmented reality object within the image.

公开(公告)号：US11954810B2

公开(公告)日：2024-04-09

申请号：US17843573

申请日：2022-06-17

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: G06V10/82 ,  G06T5/00 ,  G06T5/20 ,  G06T19/00 ,  G06V10/774 ,  G06V20/20

CPC classification number: G06T19/006 ,  G06T5/002 ,  G06T5/20 ,  G06V10/774 ,  G06V10/82 ,  G06V20/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30201

Abstract: Systems and embodiments herein describe an augmented reality (AR) object rendering system. The AR object rendering system receives an image, generates a set of noise parameters and a set of blur parameters for the image using a neural network trained on a paired dataset of images, identifies an AR object associated with the image, modifies the AR object using the set of noise parameters and the set of blur parameters, displays the modified augmented reality object within the image.

公开(公告)号：US20230419599A1

公开(公告)日：2023-12-28

申请号：US17846918

申请日：2022-06-22

Applicant: Snap Inc.

Inventor： Menglei Chai ,  Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: G06T15/50 ,  G06T15/80 ,  G06V10/82 ,  G06V10/774

CPC classification number: G06T15/506 ,  G06T15/80 ,  G06V10/82 ,  G06V10/774 ,  G06T2200/08 ,  G06T2200/04

Abstract: A method for applying lighting conditions to a virtual object in an augmented reality (AR) device is described. In one aspect, the method includes generating, using a camera of a mobile device, an image, accessing a virtual object corresponding to an object in the image, identifying lighting parameters of the virtual object based on a machine learning model that is pre-trained with a paired dataset, the paired dataset includes synthetic source data and synthetic target data, the synthetic source data includes environment maps and 3D scans of items depicted in the environment map, the synthetic target data includes a synthetic sphere image rendered in the same environment map, applying the lighting parameters to the virtual object, and displaying, in a display of the mobile device, the shaded virtual object as a layer to the image.

公开(公告)号：US20250153754A1

公开(公告)日：2025-05-15

申请号：US19024189

申请日：2025-01-16

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: B62B3/06 ,  A47B9/20 ,  A47B31/00 ,  B62B5/00 ,  B66F11/04

Abstract: Systems and embodiments herein describe an augmented reality (AR) object rendering system. The AR object rendering system receives an image, generates a set of noise parameters and a set of blur parameters for the image using a neural network trained on a paired dataset of images, identifies an AR object associated with the image, modifies the AR object using the set of noise parameters and the set of blur parameters, displays the modified augmented reality object within the image.

公开(公告)号：US12240515B2

公开(公告)日：2025-03-04

申请号：US18625568

申请日：2024-04-03

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: B66F11/04 ,  A47B9/20 ,  A47B31/00 ,  B62B3/06 ,  B62B5/00

Abstract: Systems and embodiments herein describe an augmented reality (AR) object rendering system. The AR object rendering system receives an image, generates a set of noise parameters and a set of blur parameters for the image using a neural network trained on a paired dataset of images, identifies an AR object associated with the image, modifies the AR object using the set of noise parameters and the set of blur parameters, displays the modified augmented reality object within the image.

公开(公告)号：US20240303902A1

公开(公告)日：2024-09-12

申请号：US18182117

申请日：2023-03-10

Applicant: SNAP INC.

Inventor： Vladislav Shakhrai ,  Sergey Demyanov ,  Aleksei Stoliar ,  Istvan Marton

IPC: G06T15/04 ,  G06T15/00

CPC classification number: G06T15/04 ,  G06T15/005

Abstract: The subject technology receives an object mesh, information related to a viewpoint for rendering an image of an object having a reflective surface, and a set of maps. The subject technology generates a rasterized RGB (Red Green Blue) image based on the object mesh, the viewpoint, and the set of maps. The subject technology generates, using a neural network model, an output image of the object with the reflective surface based at least in part on the rasterized RGB image and the viewpoint. The subject technology provides for display the output image of the object with the reflective surface on a display of a computer client device.