公开(公告)号：US20230215105A1

公开(公告)日：2023-07-06

申请号：US17566070

申请日：2021-12-30

Applicant: Snap Inc.

Inventor： Avilhay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Gal Sasson

IPC: G06T19/00 ,  H04N5/232 ,  G06T19/20 ,  G06V20/20 ,  G06V10/94 ,  G06V10/82 ,  G06V10/764 ,  G06N3/08

CPC classification number: G06T19/006 ,  H04N5/232939 ,  G06T19/20 ,  G06V20/20 ,  G06V10/945 ,  G06V10/82 ,  G06V10/764 ,  G06N3/08 ,  G06T2219/2016 ,  G06T2200/24

Abstract: Aspects of the present disclosure involve a system for presenting augmented reality (AR) items. The system performs operations including receiving a video that includes a depiction of a real-world environment and generating a 3D model of the real-world environment based on the video. The operations include determining, based on the 3D model of the real-world environment, that an AR item has been placed in the video at a particular 3D position and identifying a portion of the 3D model corresponding to the real-world environment currently being displayed on a screen. The operations include determining that the 3D position of the AR item is excluded from the portion of the 3D model currently being displayed on the screen and in response, displaying an indicator that identifies the 3D position of the AR item in the 3D model relative to the portion of the 3D model currently being displayed on a screen.

公开(公告)号：US20230215104A1

公开(公告)日：2023-07-06

申请号：US17566046

申请日：2021-12-30

Applicant: Snap Inc.

Inventor： Avilhay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Gal Sasson

IPC: G06T19/00 ,  G06V20/20 ,  G06V10/82 ,  G06V10/774 ,  G06V10/776 ,  G06V10/764 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06V20/20 ,  G06V10/82 ,  G06V10/774 ,  G06V10/776 ,  G06V10/764 ,  G06T19/20 ,  G06T2219/2016

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.