公开(公告)号：US20240346775A1

公开(公告)日：2024-10-17

申请号：US18477248

申请日：2023-09-28

Applicant: Snap Inc.

Inventor： Adrian Bradford ,  Christopher Cavins ,  James Vonk

IPC: G06T19/00 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06T19/20

Abstract: Methods and systems are disclosed for generating an extended reality (XR) experience using a statically positioned device. The system receives, from a camera of a stationary device, an image depicting a real-world object, the camera being directed in a stationary manner towards a specified field of view of a real-world environment. The system analyzes the image using a machine learning model to predict tracking information for the real-world object, the machine learning model trained based on a plurality of training images depicting real-world objects in the specified field of view of the real-world environment and corresponding ground-truth tracking information for the real-world objects. The system selects an extended reality (XR) experience from a plurality of XR experiences and overlays one or more XR elements associated with the XR experience on the image based on the predicted tracking information to generate a modified image.