-
公开(公告)号:US12062146B2
公开(公告)日:2024-08-13
申请号:US17815831
申请日:2022-07-28
申请人: Snap Inc.
IPC分类号: G06T19/00 , G06N3/082 , G06Q30/0601
CPC分类号: G06T19/006 , G06N3/082 , G06Q30/0643 , G06T2200/08 , G06T2200/24 , G06T2210/16 , G06T2219/024
摘要: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.
-
公开(公告)号:US20240177430A1
公开(公告)日:2024-05-30
申请号:US18435793
申请日:2024-02-07
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
IPC分类号: G06T19/00 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82 , G06V20/20
CPC分类号: G06T19/006 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82 , G06V20/20 , G06T2219/2016
摘要: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.
-
公开(公告)号:US20230419616A1
公开(公告)日:2023-12-28
申请号:US17848087
申请日:2022-06-23
申请人: Snap Inc.
CPC分类号: G06T19/006 , G06T19/20 , G06N3/02
摘要: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.
-
公开(公告)号:US20230196685A1
公开(公告)日:2023-06-22
申请号:US17557277
申请日:2021-12-21
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC分类号: G06T19/006 , G06T7/70 , G06T7/215 , G06T19/20
摘要: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.
-
公开(公告)号:US11544884B2
公开(公告)日:2023-01-03
申请号:US17119202
申请日:2020-12-11
申请人: Snap Inc.
发明人: Ma'ayan Shuvi , Avihay Assouline , Itamar Berger
IPC分类号: G06T11/60 , G06T3/00 , G06T7/11 , G06T5/50 , G06T11/00 , G06T5/40 , G06N3/08 , G06N3/04 , H04L51/046
摘要: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.
-
公开(公告)号:US20220189087A1
公开(公告)日:2022-06-16
申请号:US17119202
申请日:2020-12-11
申请人: Snap Inc.
发明人: Ma'ayan Shuvi , Avihay Assouline , Itamar Berger
摘要: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.
-
公开(公告)号:US20220157000A1
公开(公告)日:2022-05-19
申请号:US16951921
申请日:2020-11-18
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.
-
公开(公告)号:US10984575B2
公开(公告)日:2021-04-20
申请号:US16269312
申请日:2019-02-06
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Yuncheng Li
摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.
-
公开(公告)号:US20240161242A1
公开(公告)日:2024-05-16
申请号:US18068383
申请日:2022-12-19
申请人: Snap Inc.
发明人: Avihay Assouline , Nir Malbin , Iason Kokkinos , Riza Alp Guler , Himmy Tam , Mohammad Rami Koujan
CPC分类号: G06T5/50 , G06T7/70 , G06V10/761 , G06V10/82 , G06T2207/20221 , G06T2207/30196
摘要: Methods and systems are disclosed for transferring garments from one real-world object to another in real time using body landmarks. The system receives a first image that includes a depiction of a first person wearing a fashion item in a first pose. The system obtains a second image that includes a depiction of a second person in a second pose and generates a first set of body landmarks corresponding the first person in the first pose and a second set of body landmarks corresponding the second person wearing in the first pose. The system computes a deviation between the first set of body landmarks and the second set of body landmarks. The system generates a new image that depicts the second person wearing the fashion item worn by the first person based on the deviation between the first set of body landmarks and the second set of body landmarks.
-
公开(公告)号:US11928783B2
公开(公告)日:2024-03-12
申请号:US17566046
申请日:2021-12-30
申请人: Snap Inc.
发明人: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
IPC分类号: G06V20/20 , G06T19/00 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82
CPC分类号: G06T19/006 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82 , G06V20/20 , G06T2219/2016
摘要: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.
-
-
-
-
-
-
-
-
-