-
公开(公告)号:US20230419621A1
公开(公告)日:2023-12-28
申请号:US18243360
申请日:2023-09-07
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson , Itamar Berger
CPC classification number: G06T19/006 , G06T7/70 , G06V40/10 , G10L15/08 , G10L2015/088
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.
-
公开(公告)号:US11830118B2
公开(公告)日:2023-11-28
申请号:US18145718
申请日:2022-12-22
Applicant: Snap Inc.
Inventor: Ma'ayan Mishin Shuvi , Avihay Assouline , Itamar Berger
IPC: G06T11/60 , G06T7/11 , G06T5/50 , G06T11/00 , G06T5/40 , G06N3/08 , G06N3/04 , G06T3/00 , H04L51/046
CPC classification number: G06T11/60 , G06N3/04 , G06N3/08 , G06T3/0093 , G06T5/40 , G06T5/50 , G06T7/11 , G06T11/001 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/20224 , G06T2207/30196 , G06T2210/16 , H04L51/046
Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.
-
公开(公告)号:US20230343047A1
公开(公告)日:2023-10-26
申请号:US18216958
申请日:2023-06-30
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
CPC classification number: G06T19/006 , G06T7/251 , G06T17/20 , G06V40/10 , G06T2207/10016 , G06T2207/10024 , G06T2207/20212
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
公开(公告)号:US20230343007A1
公开(公告)日:2023-10-26
申请号:US18215465
申请日:2023-06-28
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Mishin Shuvi , Matan Zohar
CPC classification number: G06T11/60 , G06T7/11 , G06T11/40 , G06V20/20 , G10L15/22 , G10L15/26 , G06T2207/30196 , G06V2201/09 , H04L51/42
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item by the person depicted in the image; receiving voice input associated with the person depicted in the image; in response to receiving the voice input, generating one or more augmented reality elements representing the voice input; and applying the one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
公开(公告)号:US11763481B2
公开(公告)日:2023-09-19
申请号:US17506442
申请日:2021-10-20
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson , Itamar Berger
IPC: G06T7/70 , G06V40/10 , G06F18/24 , G06F18/214 , G06T19/00
CPC classification number: G06T7/70 , G06F18/214 , G06F18/24 , G06T19/006 , G06V40/103 , G06V40/107 , G06T2207/10016 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.
-
公开(公告)号:US11748931B2
公开(公告)日:2023-09-05
申请号:US16951921
申请日:2020-11-18
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC: G06T13/40 , G06T7/246 , G06V40/20 , H04L67/131 , G06T19/00
CPC classification number: G06T13/40 , G06T7/246 , G06T19/006 , G06V40/23 , H04L67/131 , G06T2200/24 , G06T2219/024
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.
-
公开(公告)号:US11734866B2
公开(公告)日:2023-08-22
申请号:US17447509
申请日:2021-09-13
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T11/60 , G06T7/11 , G06T11/40 , G06V20/20 , G10L15/22 , G10L15/26 , G06T2207/30196 , G06V2201/09 , H04L51/42
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item by the person depicted in the image; receiving voice input associated with the person depicted in the image; in response to receiving the voice input, generating one or more augmented reality elements representing the voice input; and applying the one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
公开(公告)号:US20230230328A1
公开(公告)日:2023-07-20
申请号:US17566032
申请日:2021-12-30
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
CPC classification number: G06T19/006 , G06N3/08 , G06T7/73 , G06T7/521 , G06T2207/20081 , G06T2207/20084
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth information related to the real-world environment; and generating a 3D model of the real-world environment. The operations further include determining 3D placement and orientation for an AR item based on data associated with the AR item and the 3D model of the real-world environment and causing display of a marker in the video that specifies the 3D placement and orientation of the AR item. The operations further include rendering a display of the AR item within the video according to the 3D placement and orientation in response to movement of the marker within the video.
-
公开(公告)号:US11670059B2
公开(公告)日:2023-06-06
申请号:US17446691
申请日:2021-09-01
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
公开(公告)号:US20230154121A1
公开(公告)日:2023-05-18
申请号:US18100080
申请日:2023-01-23
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
CPC classification number: G06T19/006 , G06T7/62 , G06T7/70 , G06T7/20 , G06T19/20 , G06T2200/24 , G06T2207/10016 , G06T2207/30196 , G06T2219/2016
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.
-
-
-
-
-
-
-
-
-