公开(公告)号：US12265664B2

公开(公告)日：2025-04-01

申请号：US18341558

申请日：2023-06-26

Applicant: Snap Inc.

Inventor： Georgios Evangelidis ,  Bernhard Jung ,  Ilteris Kaan Canberk ,  Daniel Wolf ,  Balázs Tóth ,  Márton Gergely Kajtár ,  Branislav Micusik

IPC: G09G5/00 ,  G06F3/01 ,  G06T7/246 ,  G06T7/73

Abstract: A method for aligning coordinate systems of user devices in an augmented reality system using somatic points of a user's hand as alignment markers. Images captured from multiple user devices are used to align the reference coordinate systems of the user devices to a common reference coordinate system. In some examples, user devices capture images of a hand of a user and use object recognition to identify somatic points as alignment markers. The somatic points of a user device are translated to a common reference coordinate system determined by another user device.

公开(公告)号：US12236512B2

公开(公告)日：2025-02-25

申请号：US17893696

申请日：2022-08-23

Applicant: Snap Inc.

Inventor： Lien Le Hong Tran ,  Matthew Saunders ,  Daria Skrypnyk ,  Ilteris Kaan Canberk

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/0346 ,  G06T13/40 ,  G10L25/78 ,  H04L65/1069

Abstract: The disclosed system establishes, by a first augmented reality (AR) device, a voice communication session between a plurality of users. The system displays, by the first AR device of a first user of the plurality of users, an avatar representing a second user of the plurality of users. The system receives, by the first AR device of a first user of the plurality of users, input from the first user that selects a display position for the avatar representing the second user within a real-world environment of the first user. The system animates the avatar representing the second user based on movement information received from a second AR device of the second user.

公开(公告)号：US20240355079A1

公开(公告)日：2024-10-24

申请号：US18305887

申请日：2023-04-24

Applicant: Snap Inc.

Inventor： Lien Le Hong Tran ,  Olha Borys ,  Ilteris Kaan Canberk ,  Tobias Maier ,  Jakob Zillner

IPC: G06T19/20 ,  G06T5/20 ,  G06T19/00 ,  G06V10/44 ,  G06V10/74

CPC classification number: G06T19/20 ,  G06T5/20 ,  G06T19/006 ,  G06V10/44 ,  G06V10/761 ,  G06T2219/2004

Abstract: A system is disclosed, including a processor and a memory. The memory stores instructions that, when executed by the processor, configure the system to perform operations. Surface plane information is obtained, defining a surface plane passing through a surface location and oriented according to a surface normal. An edge is detected in an image. Virtual content is presented, having a virtual position based on an orientation of the edge and the surface plane information.

公开(公告)号：US20230079325A1

公开(公告)日：2023-03-16

申请号：US18056122

申请日：2022-11-16

Applicant: Snap Inc.

Inventor： Kaveh Anvaripour ,  Ilteris Kaan Canberk ,  Virginia Drummond ,  Jean Luo ,  Alek Matthiessen ,  Celia Nicole Mourkogiannis

IPC: G06T19/00 ,  G06F3/041 ,  G06T13/20 ,  H04W4/024 ,  H04W4/029

Abstract: The subject technology receives, at a client device, a selection of a first selectable graphical item, the first selectable graphical item comprising a first augmented reality content generator corresponding to a particular geolocation. The subject technology causes display, at the client device, of a graphical interface comprising a plurality of selectable augmented reality content items, each selectable augmented reality content item corresponding to a particular activity based at in part on the particular geolocation. The subject technology receives, at the client device, a second selection of a particular selectable augmented reality content item from the plurality of selectable augmented reality content items. The subject technology causes display, at the client device, at least one second augmented reality content item generated by the first augmented reality content generator, the at least one second augmented content item comprising a three-dimensional (3D) scene based at least in part on the particular geolocation.

公开(公告)号：US20250157162A1

公开(公告)日：2025-05-15

申请号：US19024157

申请日：2025-01-16

Applicant: Snap Inc.

Inventor： Luke Cartwright ,  Ilteris Kaan Canberk

IPC: G06T19/00 ,  G02B27/01 ,  G06F3/01 ,  G06T19/20

Abstract: A head-wearable apparatus determines an imaginary reference plane intersecting a head of a user viewing augmented content in a viewing pane having vertical and lateral dimensions in a display of the head-wearable apparatus. The imaginary reference plane coincides with a first viewing direction of the head of the user. The apparatus detects a rotational movement of the head of the user in a vertical direction while viewing the augmented content. In response to the detected rotational movement, the apparatus determines a second viewing direction of the head of the user when viewing the augmented content in the second viewing direction and determines a reference angle between the imaginary reference plane and the second viewing direction. Based on the reference angle, the apparatus assign one of a billboard display mode and a headlock display mode (or combination) to the augmented content presented in the display.

公开(公告)号：US12051163B2

公开(公告)日：2024-07-30

申请号：US17895449

申请日：2022-08-25

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Matthew Hallberg ,  Matthew Saunders ,  Daria Skrypnyk ,  Lien Le Hong Tran

IPC: G06F3/01 ,  G06T13/40 ,  G06T19/00

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06T13/40

Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device using an external vision system. The system establishes, by the AR device, a communication with an external client device. The system overlays, by the AR device, a first AR object on a real-world environment being viewed using the AR device. The system receives interaction data from the external client device representing movement of a user determined by the external client device. The system, in response to receiving the interaction data from the external client device, modifies the first AR object by the AR device.

公开(公告)号：US20240177328A1

公开(公告)日：2024-05-30

申请号：US18435797

申请日：2024-02-07

Applicant: Snap Inc.

Inventor： Olha Borys ,  Ilteris Kaan Canberk ,  Daniel Wagner ,  Jakob Zillner

IPC: G06T7/593 ,  G06T7/73 ,  G06T15/00 ,  H04N13/00 ,  H04N13/128 ,  H04N13/204

CPC classification number: G06T7/593 ,  G06T7/73 ,  G06T15/00 ,  H04N13/128 ,  H04N13/204 ,  G06T2207/10012 ,  H04N2013/0081

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for continuous surface and depth estimation. A continuous surface and depth estimation system determines the depth and surface normal of physical objects by using stereo vision limited within a predetermined window.

公开(公告)号：US20240127550A1

公开(公告)日：2024-04-18

申请号：US18046367

申请日：2022-10-13

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Matthew Hallberg ,  Bernhard Jung

IPC: G06T19/00 ,  G06T7/70

CPC classification number: G06T19/006 ,  G06T7/70 ,  G06T2200/24 ,  G06T2207/10028 ,  G06T2210/56 ,  G06T2219/004

Abstract: Systems, methods, and computer readable media for remote annotations, drawings, and navigation instructions sent to an augmented reality (AR) wearable device from a computing device are disclosed. The AR wearable device captures images and sends them to the remote computing device to provide a real-time view of what the user of the AR wearable device sees. A user of the remote computing device can add navigation instructions and can select an image to annotate or draw on. The AR wearable device provides 3-dimensional (3D) coordinate information within a 3D world of the AR wearable device for the selected image. The user of the remote computing device then annotates or draws on the selected image. The remote computing device determines 3D coordinates for the annotations and drawings within the 3D world of the AR wearable device. The annotations and drawings are sent to the AR wearable device with associated 3D coordinates.

公开(公告)号：US11836826B2

公开(公告)日：2023-12-05

申请号：US17235280

申请日：2021-04-20

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Virginia Drummond ,  Jean Luo ,  Alek Matthiessen ,  Celia Nicole Mourkogiannis

IPC: G06T19/00 ,  G06F3/0488 ,  G06F3/04817

CPC classification number: G06T19/003 ,  G06F3/0488 ,  G06F3/04817 ,  G06T19/006

Abstract: The subject technology selects a set of augmented reality content generators from a plurality of augmented reality content generators. The subject technology causes display, at a client device, of a graphical interface comprising a plurality of selectable graphical items. The subject technology receives, at the client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item comprising a first augmented reality content generator corresponding to a particular geolocation. The subject technology causes display, at the client device, at least one augmented content reality item generated by the first augmented reality content generator. The subject technology causes display, at a second client device, the at least one augmented content reality item generated by the first augmented reality content generator, the at least one augmented content reality item comprising the 3D scene based at least in part on the particular geolocation.

公开(公告)号：US20220374131A1

公开(公告)日：2022-11-24

申请号：US17448169

申请日：2021-09-20

Applicant: Snap Inc.

Inventor： Karen Stolzenberg ,  David Meisenholder ,  Mathieu Emmanuel Vignau ,  Joseph Timothy Fortier ,  Kaveh Anvaripour ,  Daniel Moreno ,  Kyle Goodrich ,  Ilteris Kaan Canberk ,  Shin Hwun Kang

IPC: G06F3/0481 ,  G06F3/0485 ,  G06F3/0488 ,  G02B27/01 ,  G06T19/00

Abstract: Disclosed is a method of receiving and processing navigation inputs executed by one or more processors in a head-worn device system including one or more display devices, one or more cameras and a generally vertically-arranged touchpad. The method comprises displaying a first carousel of AR effects icons, receiving a first horizontal input on the touchpad, rotating the first carousel of AR effects icons in response to first horizontal input, receiving a first touch input on the touchpad to select a particular AR effects icon that is in a selection position in the first carousel, displaying a scene viewed by the one or more cameras, the scene being enhanced with AR effects corresponding to the particular AR effects icon, receiving content capture user input, and in response to the content capture user input, capturing a new content item corresponding to the scene.