REAL-TIME UPPER-BODY GARMENT EXCHANGE
    52.
    发明公开

    公开(公告)号:US20240096040A1

    公开(公告)日:2024-03-21

    申请号:US18525285

    申请日:2023-11-30

    申请人: Snap Inc.

    摘要: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.

    BACKGROUND REPLACEMENT USING NEURAL RADIANCE FIELD

    公开(公告)号:US20240007585A1

    公开(公告)日:2024-01-04

    申请号:US17852919

    申请日:2022-06-29

    申请人: Snap Inc.

    摘要: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses an image depicting a person and one or more camera parameters representing a viewpoint associated with a camera used to capture the image. The system extracts a portion of the image comprising the depiction of the person. The system processes, by a neural radiance field (NeRF) machine learning model, the one or more camera parameters to render an estimated depiction of a scene from the viewpoint associated with the camera used to capture the image. The system combines the portion of the image comprising the depiction of the person with the estimated depiction of the scene to generate an output image and causes the output image to be presented on a client device.

    Augmented reality anthropomorphtzation system

    公开(公告)号:US11676319B2

    公开(公告)日:2023-06-13

    申请号:US17812071

    申请日:2022-07-12

    申请人: Snap Inc.

    IPC分类号: G06T11/60 G06T13/80 G06V20/10

    CPC分类号: G06T11/60 G06T13/80 G06V20/10

    摘要: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.

    Skeletal tracking using previous frames

    公开(公告)号:US11594025B2

    公开(公告)日:2023-02-28

    申请号:US17240457

    申请日:2021-04-26

    申请人: Snap Inc.

    摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.

    PERSONALIZED AVATAR REAL-TIME MOTION CAPTURE

    公开(公告)号:US20220383577A1

    公开(公告)日:2022-12-01

    申请号:US17818539

    申请日:2022-08-09

    申请人: Snap Inc.

    摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.