公开(公告)号：US20250168206A1

公开(公告)日：2025-05-22

申请号：US19027941

申请日：2025-01-17

Applicant: Snap Inc.

Inventor： Kristian Bauer ,  Tiago Rafael Duarte ,  Terek Judi ,  Shin Hwun Kang ,  Karen Stolzenberg

IPC: H04L65/1069 ,  G02B27/01 ,  G06F3/14

Abstract: A system includes one or more cameras, one or more display devices, one or more processors, and memory storing instructions that configure the system to perform operations to initiate or join a collaborative computing session. The method may comprise receiving user input to initiate a new collaborative computing session, determining that a current collaborative computing session of the same type is in progress on a second, physically-present device, based on determining that the current collaborative computing session is in progress on the second, physically-present device, providing a user input option to join the current collaborative computing session using the first device instead of starting the new collaborative computing session.

公开(公告)号：US12260061B2

公开(公告)日：2025-03-25

申请号：US18382872

申请日：2023-10-23

Applicant: Snap Inc.

Inventor： Shin Hwun Kang

IPC: G06F3/04815 ,  G06F3/01 ,  G06F3/04886 ,  G06T11/00 ,  G06V20/20 ,  G16Y40/30 ,  H04N23/63 ,  G06F3/04842

Abstract: Systems and methods for controlling an Internet of Things (IoT) device through interaction with an augmented reality (AR) camera includes pairing an interactable augmented reality (AR) overlay with the IoT device. The interactable overlay includes control information for generating a control signal for controlling the IoT device when the interactable overlay is interacted with by the AR camera. The interactable overlay is presented on a display of the AR camera when the IoT device is in a field of view of the AR camera. An indication that the user has pointed the AR camera at the interactable overlay associated with the IoT device on the display of the AR camera is provided, and a control signal associated with the interactable overlay pointed at by the AR camera is provided to the at least one IoT device associated with the interactable overlay pointed at by the AR camera.

公开(公告)号：US12260015B2

公开(公告)日：2025-03-25

申请号：US18382737

申请日：2023-10-23

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang ,  Doug Mead

IPC: G06F3/01 ,  G06F18/22 ,  G06T7/73 ,  H04B1/3827 ,  H04W4/029

Abstract: Systems, devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device. A portable eyewear device includes a processor, a memory, and a display projected onto at least one lens assembly. The memory has programming stored therein that, when executed by the processor, captures information depicting an environment surrounding the device and identifies a match between objects in that information and predetermined objects in previously obtained information for the same environment. When the position of the eyewear device reaches a preselected location with respect to the matched objects, a physical output is provided to produce the immersive experience. The physical output changes as the position of the eyewear device moves to maintain the immersive experience.

公开(公告)号：US12249036B2

公开(公告)日：2025-03-11

申请号：US18391879

申请日：2023-12-21

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang ,  Dmytro Kucher

IPC: G06T19/00 ,  G02B27/01 ,  G06T7/73 ,  G06V40/10 ,  G10L15/26 ,  H04N13/111 ,  H04N13/207 ,  H04N13/332

Abstract: Eyewear presenting text corresponding to spoken words (e.g., in speech bubbles) and optionally translating from one language to another. In one example, an interactive augmented reality experience is provided between two users of eyewear devices to allow one user of an eyewear device to share a personal attribute of the user with a second user. The personal attribute can be speech spoken by a remote second user of eyewear converted to text. The converted text can be displayed on a display of eyewear of the first user proximate the viewed second user. The personal attribute may be displayed in a speech bubble proximate the second user, such as proximate the head or mouth of the second user. The language of the spoken speech can be recognized by the second user eyewear, and translated to a language that is understood by the first user. In another example, the spoken words of a remote person is captured by the eyewear of a user, the position of the remote person is identified, the spoken word are converted to text, and the text is displayed (e.g., in a speech bubble) on an AR display of the eyewear adjacent the remote person.

公开(公告)号：US12236535B2

公开(公告)日：2025-02-25

申请号：US18510286

申请日：2023-11-15

Applicant: Snap Inc.

Inventor： Shin Hwun Kang ,  Dmytro Kucher ,  Dmytro Hovorov ,  Ilteris Canberk

IPC: G06T19/00 ,  G02B27/01 ,  G06T7/73

Abstract: Augmented reality guidance for guiding a user through an environment using an eyewear device. The eyewear device includes a display system and a position detection system. A user is guided though an environment by monitoring a current position of the eyewear device within the environment, identifying marker positions within a threshold of the current position, the marker positions defined with respect to the environment and associated with guidance markers, registering the marker positions, generating overlay image including the guidance markers, and presenting the overlay image on a display of the eyewear device.

公开(公告)号：US20240393887A1

公开(公告)日：2024-11-28

申请号：US18797805

申请日：2024-08-08

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Viktoria Hwang ,  Shin Hwun Kang ,  David Meisenholder ,  Daniel Moreno

IPC: G06F3/01 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04847 ,  G06T19/00 ,  G06V20/40 ,  G06V40/10 ,  G06V40/20

Abstract: Example systems, devices, media, and methods are described for controlling virtual elements or graphical elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a series of hand shapes in the video data and determines whether it matches a predefined series of hand gestures. Each predefined series of hand gestures is associated with an action. The system controls movement of the virtual element, relative to the display, in accordance with the associated action. In an example hand shape that includes a thumb sliding along an extended finger, the system establishes a finger scale along the extended finger, calibrates a graphical scale with the finger scale, and controls movement of an interactive graphical element, such as a slider, according to the current thumb position relative to the calibrated graphical scale.

公开(公告)号：US20240112383A1

公开(公告)日：2024-04-04

申请号：US17959985

申请日：2022-10-04

Applicant: Snap Inc.

Inventor： Shin Hwun Kang ,  Lien Le Hong Tran

IPC: G06T11/60 ,  G06F3/01 ,  G06F3/0482 ,  G06T7/70

CPC classification number: G06T11/60 ,  G06F3/013 ,  G06F3/0482 ,  G06T7/70 ,  G06T2200/24

Abstract: An augmented reality (AR) content system is provided. The AR content system may analyze audio input obtained from a user to generate a search request. The AR content system may obtain search results in response to the search request and determine a layout by which to display the search results. The search results may be displayed in a user interface within an AR environment according to the layout. The AR content system may also analyze audio input to detect commands to perform with respect to content displayed in the user interface.

公开(公告)号：US20240087237A1

公开(公告)日：2024-03-14

申请号：US18510286

申请日：2023-11-15

Applicant: Snap Inc.

Inventor： Shin Hwun Kang ,  Dmytro Kucher ,  Dmytro Hovorov ,  Ilteris Canberk

IPC: G06T19/00 ,  G02B27/01 ,  G06T7/73

CPC classification number: G06T19/003 ,  G02B27/0172 ,  G02B27/0176 ,  G06T7/73 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T2207/30204

Abstract: Augmented reality guidance for guiding a user through an environment using an eyewear device. The eyewear device includes a display system and a position detection system. A user is guided though an environment by monitoring a current position of the eyewear device within the environment, identifying marker positions within a threshold of the current position, the marker positions defined with respect to the environment and associated with guidance markers, registering the marker positions, generating overlay image including the guidance markers, and presenting the overlay image on a display of the eyewear device.

公开(公告)号：US20210405363A1

公开(公告)日：2021-12-30

申请号：US17359969

申请日：2021-06-28

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang

IPC: G02B27/01 ,  G02B27/00 ,  G08B3/10 ,  G06T19/00

Abstract: Augmented reality experiences with an eyewear device including a position detection system and a display system are provided. The eyewear device allows setting a predefined distance target or distance targets. The eyewear device monitors the distance between the eyewear device and one or more other persons using the position detection system of the eyewear device. The eyewear device generates an alert if one or more of the other persons is within the one or more predefined distance targets.

公开(公告)号：US12256211B2

公开(公告)日：2025-03-18

申请号：US18198055

申请日：2023-05-16

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang ,  James Powderly

IPC: H04S7/00 ,  G02B27/01 ,  G06T19/00 ,  H04W4/029

Abstract: Systems, devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device with spatial audio. The eyewear device has a processor, a memory, an image sensor, and speakers. The eyewear device captures image information for an environment surrounding the device, identifies a match between objects in the image information and predetermined objects in previously obtained information for the same environment. The eyewear device then identifies a target location within the environment, which may be associated with a physical or a virtual object. The eyewear device monitors its orientation with respect to the target location and presents audio signals to guide the user toward the target location.