-
公开(公告)号:US10984575B2
公开(公告)日:2021-04-20
申请号:US16269312
申请日:2019-02-06
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Yuncheng Li
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.
-
公开(公告)号:US12299775B2
公开(公告)日:2025-05-13
申请号:US18111632
申请日:2023-02-20
Applicant: Snap Inc.
Inventor: Hanna Davidovich , Nir Malbin , Avihay Assouline
Abstract: Aspects of the present disclosure involve a system for an augmented reality (AR) try-on experience with lighting adjustment. The system accesses an image that depicts a real-world person. The system retrieves an AR fashion item. The system applies the image and the AR fashion item to a machine learning model to estimate a lighting adjustment for the AR fashion item based on lighting properties of the real-world person depicted in the image, the machine learning model trained to match lighting properties of images depicting real-world objects to lighting properties of AR objects and vice versa. The system combines the AR fashion item with the image that depicts the real-world person based on the estimated lighting adjustment to generate a modified image.
-
公开(公告)号:US12243173B2
公开(公告)日:2025-03-04
申请号:US18100080
申请日:2023-01-23
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.
-
公开(公告)号:US20240404005A1
公开(公告)日:2024-12-05
申请号:US18205674
申请日:2023-06-05
Applicant: Snap Inc.
Inventor: Jonathan Heimann , Nir Malbin , Avihay Assouline , Gal Sasson
Abstract: Methods and systems are disclosed for generating high resolution images using lower resolution machine learning models. The system receives one or more images depicting a real-world object in a real-world scene and receives a source image depicting a fashion item comprising a target. The system processes, using one or more machine learning models, the one or more images together with the source image to generate a new image depicting the real-world object wearing the fashion item depicted in the source image, the new image having a lower image resolution than an image resolution of the source image. The system selectively blends pixels of the new image with pixels of the source image to generate a virtual extended reality (XR) experience.
-
公开(公告)号:US20240371197A1
公开(公告)日:2024-11-07
申请号:US18773011
申请日:2024-07-15
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Jean Luo , Matan Zohar
IPC: G06V40/16 , A61B90/00 , G06F3/01 , G06Q30/0601 , G06T19/00 , G06T19/20 , G06V20/00 , G06V20/20 , H04N13/00
Abstract: Methods and systems are disclosed for performing operations comprising: receiving, by one or more processors, an image that includes a depiction of a face of a user; computing a real-world scale of the face of the user based on a selected subset of landmarks of the face of the user; obtaining an augmented reality graphical element comprising augmented reality eyewear; scaling the augmented reality graphical element based on the computed real-world scale of the face; and positioning the scaled augmented reality graphical element within the image on the face of the user.
-
公开(公告)号:US20240161242A1
公开(公告)日:2024-05-16
申请号:US18068383
申请日:2022-12-19
Applicant: Snap Inc.
Inventor: Avihay Assouline , Nir Malbin , Iason Kokkinos , Riza Alp Guler , Himmy Tam , Mohammad Rami Koujan
CPC classification number: G06T5/50 , G06T7/70 , G06V10/761 , G06V10/82 , G06T2207/20221 , G06T2207/30196
Abstract: Methods and systems are disclosed for transferring garments from one real-world object to another in real time using body landmarks. The system receives a first image that includes a depiction of a first person wearing a fashion item in a first pose. The system obtains a second image that includes a depiction of a second person in a second pose and generates a first set of body landmarks corresponding the first person in the first pose and a second set of body landmarks corresponding the second person wearing in the first pose. The system computes a deviation between the first set of body landmarks and the second set of body landmarks. The system generates a new image that depicts the second person wearing the fashion item worn by the first person based on the deviation between the first set of body landmarks and the second set of body landmarks.
-
公开(公告)号:US11928783B2
公开(公告)日:2024-03-12
申请号:US17566046
申请日:2021-12-30
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
IPC: G06V20/20 , G06T19/00 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82
CPC classification number: G06T19/006 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82 , G06V20/20 , G06T2219/2016
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.
-
公开(公告)号:US11887260B2
公开(公告)日:2024-01-30
申请号:US17566070
申请日:2021-12-30
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
CPC classification number: G06T19/006 , G06N3/08 , G06T19/20 , G06V10/764 , G06V10/82 , G06V10/945 , G06V20/20 , H04N23/633 , G06T2200/24 , G06T2219/2016
Abstract: Aspects of the present disclosure involve a system for presenting augmented reality (AR) items. The system performs operations including receiving a video that includes a depiction of a real-world environment and generating a 3D model of the real-world environment based on the video. The operations include determining, based on the 3D model of the real-world environment, that an AR item has been placed in the video at a particular 3D position and identifying a portion of the 3D model corresponding to the real-world environment currently being displayed on a screen. The operations include determining that the 3D position of the AR item is excluded from the portion of the 3D model currently being displayed on the screen and in response, displaying an indicator that identifies the 3D position of the AR item in the 3D model relative to the portion of the 3D model currently being displayed on a screen.
-
公开(公告)号:US11830118B2
公开(公告)日:2023-11-28
申请号:US18145718
申请日:2022-12-22
Applicant: Snap Inc.
Inventor: Ma'ayan Mishin Shuvi , Avihay Assouline , Itamar Berger
IPC: G06T11/60 , G06T7/11 , G06T5/50 , G06T11/00 , G06T5/40 , G06N3/08 , G06N3/04 , G06T3/00 , H04L51/046
CPC classification number: G06T11/60 , G06N3/04 , G06N3/08 , G06T3/0093 , G06T5/40 , G06T5/50 , G06T7/11 , G06T11/001 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/20224 , G06T2207/30196 , G06T2210/16 , H04L51/046
Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.
-
公开(公告)号:US20230343047A1
公开(公告)日:2023-10-26
申请号:US18216958
申请日:2023-06-30
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
CPC classification number: G06T19/006 , G06T7/251 , G06T17/20 , G06V40/10 , G06T2207/10016 , G06T2207/10024 , G06T2207/20212
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
-
-
-
-
-
-
-
-