Side-by-side character animation from realtime 3D body motion capture

    公开(公告)号:US12243173B2

    公开(公告)日:2025-03-04

    申请号:US18100080

    申请日:2023-01-23

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.

    Mirror-based augmented reality experience

    公开(公告)号:US12217453B2

    公开(公告)日:2025-02-04

    申请号:US18231025

    申请日:2023-08-07

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.

    9-DOF OBJECT TRACKING
    113.
    发明申请

    公开(公告)号:US20250022238A1

    公开(公告)日:2025-01-16

    申请号:US18904818

    申请日:2024-10-02

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system generates a three-dimensional (3D) bounding box for the real-world object and stabilizes the 3D bounding box based on one or more sensors of the device. The system determines a position, orientation, and dimensions of the real-world object based on the stabilized 3D bounding box and renders a display of an augmented reality (AR) item within the video based on the position, orientation, and dimensions of the real-world object.

    BROWSING-BASED AUGMENTED REALITY TRY-ON EXPERIENCE

    公开(公告)号:US20240273613A1

    公开(公告)日:2024-08-15

    申请号:US18107856

    申请日:2023-02-09

    Applicant: Snap Inc.

    CPC classification number: G06Q30/0643 G06F16/986 G06T19/006 G06T2210/16

    Abstract: Aspects of the present disclosure involve a system for providing a browsing-based augmented reality (AR) try-on experience. The system displays a graphical user interface (GUI) comprising a set of fashion items. The system receives a real-time video feed from a camera of the device, the real-time video feed depicting a person. The system retrieves a first AR fashion item corresponding to a first fashion item in the set of fashion items included in the GUI. The system modifies the real-time video feed based on application of the first AR fashion item to the depiction of the person in the real-time video feed. The system presents the modified real-time video feed together with the GUI comprising the set of fashion items.

    Controlling interactive fashion based on body gestures

    公开(公告)号:US12056832B2

    公开(公告)日:2024-08-06

    申请号:US18138269

    申请日:2023-04-24

    Applicant: Snap Inc.

    CPC classification number: G06T19/006

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.

Patent Agency Ranking