Controlling interactive fashion based on body gestures

    公开(公告)号:US11670059B2

    公开(公告)日:2023-06-06

    申请号:US17446691

    申请日:2021-09-01

    Applicant: Snap Inc.

    CPC classification number: G06T19/006

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.

    AR-based connected portal shopping
    105.
    发明授权

    公开(公告)号:US11636654B2

    公开(公告)日:2023-04-25

    申请号:US17324344

    申请日:2021-05-19

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a request from a client device of a first user to engage in a shared augmented reality (AR) shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared AR shopping experience comprising a plurality of AR items that represent real-world products overlaid on a shared real-world environment of the first and second users; determining that the second user is interacting with a first AR item of the plurality of AR items; and in response to detecting that the second user is depicted in an image captured by the client device of the first user, overlaying the first AR item on the second user in the image.

    TRUE SIZE EYEWEAR IN REAL TIME
    106.
    发明申请

    公开(公告)号:US20230120037A1

    公开(公告)日:2023-04-20

    申请号:US18068333

    申请日:2022-12-19

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.

    MIRROR-BASED AUGMENTED REALITY EXPERIENCE

    公开(公告)号:US20230116929A1

    公开(公告)日:2023-04-20

    申请号:US17506442

    申请日:2021-10-20

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.

    INFERRING INTENT FROM POSE AND SPEECH INPUT

    公开(公告)号:US20230111489A1

    公开(公告)日:2023-04-13

    申请号:US17498510

    申请日:2021-10-11

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.

    BODY NORMAL NETWORK LIGHT AND RENDERING CONTROL

    公开(公告)号:US20230100509A1

    公开(公告)日:2023-03-30

    申请号:US17490209

    申请日:2021-09-30

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.

    CONTROLLING INTERACTIVE FASHION BASED ON VOICE

    公开(公告)号:US20230078483A1

    公开(公告)日:2023-03-16

    申请号:US17447509

    申请日:2021-09-13

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item by the person depicted in the image; receiving voice input associated with the person depicted in the image; in response to receiving the voice input, generating one or more augmented reality elements representing the voice input; and applying the one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

Patent Agency Ranking