INFERRING INTENT FROM POSE AND SPEECH INPUT
    121.
    发明公开

    公开(公告)号:US20230419621A1

    公开(公告)日:2023-12-28

    申请号:US18243360

    申请日:2023-09-07

    Applicant: Snap Inc.

    CPC classification number: G06T19/006 G06T7/70 G06V40/10 G10L15/08 G10L2015/088

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.

    AR ITEM PLACEMENT IN A VIDEO
    128.
    发明公开

    公开(公告)号:US20230230328A1

    公开(公告)日:2023-07-20

    申请号:US17566032

    申请日:2021-12-30

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth information related to the real-world environment; and generating a 3D model of the real-world environment. The operations further include determining 3D placement and orientation for an AR item based on data associated with the AR item and the 3D model of the real-world environment and causing display of a marker in the video that specifies the 3D placement and orientation of the AR item. The operations further include rendering a display of the AR item within the video according to the 3D placement and orientation in response to movement of the marker within the video.

    Controlling interactive fashion based on body gestures

    公开(公告)号:US11670059B2

    公开(公告)日:2023-06-06

    申请号:US17446691

    申请日:2021-09-01

    Applicant: Snap Inc.

    CPC classification number: G06T19/006

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.

Patent Agency Ranking