公开(公告)号：US11500536B2

公开(公告)日：2022-11-15

申请号：US17245997

申请日：2021-04-30

Applicant: Snap Inc.

Inventor： John James Robertson ,  Zsolt Mathe

IPC: G06F3/0488 ,  G06F3/0346 ,  G06F3/0484 ,  G06F3/0485 ,  G06F3/0486 ,  G06N3/04 ,  G06N3/08 ,  G06F3/04883 ,  G06F3/04845

Abstract: A neural network system includes an eyewear device. The eyewear device has a movement tracker, such as an accelerometer, gyroscope, or an inertial measurement unit for measuring acceleration and rotation. The neural network system tracks, via the movement tracker, movement of the eyewear device from at least one finger contact inputted from a user on an input surface. The neural network system identifies a finger gesture by detecting at least one detected touch event based on variation of the tracked movement of the eyewear device over a time period. The neural network system adjusts the image presented on the image display of the eyewear device based on the identified finger gesture. The neural network system can also detect whether the user is wearing the eyewear device and identify an activity of the user wearing the eyewear device based on the variation of the tracked movement over the time period.

公开(公告)号：US11039394B2

公开(公告)日：2021-06-15

申请号：US16778265

申请日：2020-01-31

Applicant: Snap Inc.

Inventor： Yu Jiang Tham ,  John James Robertson ,  Gerald Nilles ,  Jason Heger ,  Praveen Babu Vadivelu

IPC: H04W24/00 ,  H04W52/02 ,  H04B1/3827 ,  G01S5/00 ,  H04W4/029

Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.

公开(公告)号：US10996846B2

公开(公告)日：2021-05-04

申请号：US16569884

申请日：2019-09-13

Applicant: Snap Inc.

Inventor： John James Robertson ,  Zsolt Mathe

IPC: G06F3/0488 ,  G06F3/0485 ,  G06F3/0484 ,  G06F3/0486 ,  G06F3/0346 ,  G06N3/04 ,  G06N3/08

Abstract: A neural network system includes an eyewear device. The eyewear device has a movement tracker, such as an accelerometer, gyroscope, or an inertial measurement unit for measuring acceleration and rotation. The neural network system tracks, via the movement tracker, movement of the eyewear device from at least one finger contact inputted from a user on an input surface. The neural network system identifies a finger gesture by detecting at least one detected touch event based on variation of the tracked movement of the eyewear device over a time period. The neural network system adjusts the image presented on the image display of the eyewear device based on the identified finger gesture. The neural network system can also detect whether the user is wearing the eyewear device and identify an activity of the user wearing the eyewear device based on the variation of the tracked movement over the time period.

公开(公告)号：US20240251356A1

公开(公告)日：2024-07-25

申请号：US18623770

申请日：2024-04-01

Applicant: Snap Inc.

Inventor： Yu Jiang Tham ,  John James Robertson ,  Gerald Nilles ,  Jason Heger ,  Praveen Babu Vadivelu

IPC: H04W52/02 ,  H04B1/3827 ,  H04W4/029

CPC classification number: H04W52/0261 ,  H04B1/385 ,  H04B2001/3866 ,  H04W4/029

Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.

公开(公告)号：US12015842B2

公开(公告)日：2024-06-18

申请号：US17460244

申请日：2021-08-29

Applicant: Snap Inc.

Inventor： Bo Ding ,  Chintan Doshi ,  Alexander Kane ,  John James Robertson ,  Dmitry Ryuma

IPC: H04N23/65 ,  G06T1/20 ,  G06T3/40 ,  H04N5/04 ,  H04N5/265 ,  H04N23/667 ,  H04N23/90 ,  H04N23/951

CPC classification number: H04N23/651 ,  G06T1/20 ,  G06T3/40 ,  H04N5/04 ,  H04N5/265 ,  H04N23/667 ,  H04N23/90 ,  H04N23/951

Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.

公开(公告)号：US11963105B2

公开(公告)日：2024-04-16

申请号：US18167622

申请日：2023-02-10

Applicant: Snap Inc.

Inventor： Yu Jiang Tham ,  John James Robertson ,  Gerald Nilles ,  Jason Heger ,  Praveen Babu Vadivelu

IPC: H04W24/00 ,  H04B1/3827 ,  H04W52/02 ,  H04W4/029

CPC classification number: H04W52/0261 ,  H04B1/385 ,  H04B2001/3866 ,  H04W4/029

Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.

公开(公告)号：US20230189155A1

公开(公告)日：2023-06-15

申请号：US18167622

申请日：2023-02-10

Applicant: Snap Inc.

Inventor： Yu Jiang Tham ,  John James Robertson ,  Gerald Nilles ,  Jason Heger ,  Praveen Babu Vadivelu

IPC: H04W52/02 ,  H04B1/3827

CPC classification number: H04W52/0261 ,  H04B1/385 ,  H04B2001/3866 ,  H04W4/029

Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.

公开(公告)号：US11606755B2

公开(公告)日：2023-03-14

申请号：US17331391

申请日：2021-05-26

Applicant: Snap Inc.

Inventor： Yu Jiang Tham ,  John James Robertson ,  Gerald Nilles ,  Jason Heger ,  Praveen Babu Vadivelu

IPC: H04W24/00 ,  H04W52/02 ,  H04B1/3827 ,  H04W4/029

Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.

公开(公告)号：US20220159576A1

公开(公告)日：2022-05-19

申请号：US17456284

申请日：2021-11-23

Applicant: Snap, Inc.

Inventor： Yu Jiang Tham ,  John James Robertson ,  Gerald Nilles ,  Jason Heger ,  Praveen Babu Vadivelu

IPC: H04W52/02 ,  H04B1/3827 ,  G01S19/48

Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. Performance of such devices is improved with reduced time to first fix of location operations in conjunction with low-power operations. In one embodiment, low-power circuitry manages high-speed circuitry and location circuitry to provide location assistance data from the high-speed circuitry to the low-power circuitry automatically on initiation of location fix operations as the high-speed circuitry and location circuitry are booted from low-power states. In some embodiments, the high-speed circuitry is returned to a low-power state prior to completion of a location fix and after capture of content associated with initiation of the location fix. In some embodiments, high-speed circuitry is booted after completion of a location fix to update location data associated with content.

公开(公告)号：US20220103757A1

公开(公告)日：2022-03-31

申请号：US17460244

申请日：2021-08-29

Applicant: Snap Inc.

Inventor： Bo Ding ,  Chintan Doshi ,  Alexander Kane ,  John James Robertson ,  Dmitry Ryuma

IPC: H04N5/232 ,  G06T1/20 ,  G06T3/40 ,  H04N5/247 ,  H04N5/04 ,  H04N5/265

Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.