公开(公告)号：US20240282066A1

公开(公告)日：2024-08-22

申请号：US18653609

申请日：2024-05-02

Applicant: Snap Inc.

Inventor： Artem Bondich ,  Menglei Chai ,  Olekssandr Pyshchenko ,  Jian Ren ,  Sergey Tulyakov

IPC: G06T19/00 ,  G06F18/214 ,  G06N3/045 ,  G06N3/08 ,  G06T7/246 ,  G06T17/00 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06F18/214 ,  G06N3/045 ,  G06N3/08 ,  G06T7/251 ,  G06T17/00 ,  G06T19/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2215/16 ,  G06T2219/024 ,  G06T2219/2024

Abstract: A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.