Body pose estimation
    11.
    发明授权

    公开(公告)号:US10984575B2

    公开(公告)日:2021-04-20

    申请号:US16269312

    申请日:2019-02-06

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.

    Augmented reality experience with lighting adjustment

    公开(公告)号:US12299775B2

    公开(公告)日:2025-05-13

    申请号:US18111632

    申请日:2023-02-20

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system for an augmented reality (AR) try-on experience with lighting adjustment. The system accesses an image that depicts a real-world person. The system retrieves an AR fashion item. The system applies the image and the AR fashion item to a machine learning model to estimate a lighting adjustment for the AR fashion item based on lighting properties of the real-world person depicted in the image, the machine learning model trained to match lighting properties of images depicting real-world objects to lighting properties of AR objects and vice versa. The system combines the AR fashion item with the image that depicts the real-world person based on the estimated lighting adjustment to generate a modified image.

    Side-by-side character animation from realtime 3D body motion capture

    公开(公告)号:US12243173B2

    公开(公告)日:2025-03-04

    申请号:US18100080

    申请日:2023-01-23

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.

    HIGH RESOLUTION SYNTHESIS USING SHADERS

    公开(公告)号:US20240404005A1

    公开(公告)日:2024-12-05

    申请号:US18205674

    申请日:2023-06-05

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for generating high resolution images using lower resolution machine learning models. The system receives one or more images depicting a real-world object in a real-world scene and receives a source image depicting a fashion item comprising a target. The system processes, using one or more machine learning models, the one or more images together with the source image to generate a new image depicting the real-world object wearing the fashion item depicted in the source image, the new image having a lower image resolution than an image resolution of the source image. The system selectively blends pixels of the new image with pixels of the source image to generate a virtual extended reality (XR) experience.

    REAL-TIME TRY-ON USING BODY LANDMARKS
    16.
    发明公开

    公开(公告)号:US20240161242A1

    公开(公告)日:2024-05-16

    申请号:US18068383

    申请日:2022-12-19

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for transferring garments from one real-world object to another in real time using body landmarks. The system receives a first image that includes a depiction of a first person wearing a fashion item in a first pose. The system obtains a second image that includes a depiction of a second person in a second pose and generates a first set of body landmarks corresponding the first person in the first pose and a second set of body landmarks corresponding the second person wearing in the first pose. The system computes a deviation between the first set of body landmarks and the second set of body landmarks. The system generates a new image that depicts the second person wearing the fashion item worn by the first person based on the deviation between the first set of body landmarks and the second set of body landmarks.

Patent Agency Ranking