-
公开(公告)号:US12002175B2
公开(公告)日:2024-06-04
申请号:US18216958
申请日:2023-06-30
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
CPC分类号: G06T19/006 , G06T7/251 , G06T17/20 , G06V40/10 , G06T2207/10016 , G06T2207/10024 , G06T2207/20212
摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
公开(公告)号:US20240096040A1
公开(公告)日:2024-03-21
申请号:US18525285
申请日:2023-11-30
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC分类号: G06T19/006 , G06T7/215 , G06T7/70 , G06T19/20
摘要: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.
-
公开(公告)号:US20240037858A1
公开(公告)日:2024-02-01
申请号:US17815831
申请日:2022-07-28
申请人: Snap Inc.
CPC分类号: G06T19/006 , G06Q30/0643 , G06N3/082 , G06T2200/24 , G06T2200/08 , G06T2210/16 , G06T2219/024
摘要: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.
-
公开(公告)号:US20240007585A1
公开(公告)日:2024-01-04
申请号:US17852919
申请日:2022-06-29
申请人: Snap Inc.
摘要: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses an image depicting a person and one or more camera parameters representing a viewpoint associated with a camera used to capture the image. The system extracts a portion of the image comprising the depiction of the person. The system processes, by a neural radiance field (NeRF) machine learning model, the one or more camera parameters to render an estimated depiction of a scene from the viewpoint associated with the camera used to capture the image. The system combines the portion of the image comprising the depiction of the person with the estimated depiction of the scene to generate an output image and causes the output image to be presented on a client device.
-
公开(公告)号:US20230360301A1
公开(公告)日:2023-11-09
申请号:US18222799
申请日:2023-07-17
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC分类号: G06T13/40 , G06T7/246 , G06V40/20 , H04L67/131 , G06T19/00
CPC分类号: G06T13/40 , G06T7/246 , G06V40/23 , H04L67/131 , G06T19/006 , G06T2200/24 , G06T2219/024
摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.
-
公开(公告)号:US11734894B2
公开(公告)日:2023-08-22
申请号:US16951939
申请日:2020-11-18
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
CPC分类号: G06T19/006 , G06T7/251 , G06T17/20 , G06V40/10 , G06T2207/10016 , G06T2207/10024 , G06T2207/20212
摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
公开(公告)号:US20230260127A1
公开(公告)日:2023-08-17
申请号:US17650918
申请日:2022-02-14
申请人: Snap Inc.
发明人: Shani Ben Baruch , Ma'ayan Mishin Shuvi , Gal Dudovitch , Avihay Assouline , Itamar Berger , Gal Sasson
CPC分类号: G06T7/11 , G06T11/00 , G06T5/005 , G06T2207/20092 , G06T2207/20081 , G06T2207/10016 , G06T2207/20132
摘要: Methods and systems are disclosed for performing operations for segmenting an object. The operations include receiving an image that includes a depiction of a first object; receiving a first segmentation dataset; applying a first machine learning technique to the first segmentation dataset and the image to estimate a first segmentation of the first object depicted in the image; generating a second segmentation dataset that includes the estimated first segmentation and a correction to the estimated first segmentation of the first object; applying the first machine learning technique to the second segmentation dataset and the image to estimate a second segmentation of the first object depicted in the image; and applying an augmented reality experience to the image based on the estimated second segmentation of the first object.
-
公开(公告)号:US11676319B2
公开(公告)日:2023-06-13
申请号:US17812071
申请日:2022-07-12
申请人: Snap Inc.
摘要: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.
-
公开(公告)号:US11594025B2
公开(公告)日:2023-02-28
申请号:US17240457
申请日:2021-04-26
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC分类号: G06T17/20 , G06V20/20 , G06K9/62 , H04N21/4402 , G06V20/40 , G06V20/64 , G06V40/20 , H04L51/04
摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.
-
公开(公告)号:US20220383577A1
公开(公告)日:2022-12-01
申请号:US17818539
申请日:2022-08-09
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC分类号: G06T13/40 , G06F3/04817 , G06T19/00 , G06T15/20 , G06F3/0488 , G06T7/20
摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.
-
-
-
-
-
-
-
-
-