公开(公告)号：US20220157083A1

公开(公告)日：2022-05-19

申请号：US17590036

申请日：2022-02-01

Applicant: APPLE INC.

Inventor： Sai Harsha JANDHYALA ,  Raffi A. BEDIKIAN

IPC: G06V40/20 ,  G06V10/70 ,  G06T7/246 ,  G06T7/73 ,  G06T7/90

Abstract: Various implementations disclosed herein include devices, systems, and methods that identify a gesture based on event camera data and frame-based camera data (e.g., for a CGR environment). In some implementations at an electronic device having a processor, event camera data is obtained corresponding to light (e.g., IR light) reflected from a physical environment and received at an event camera. In some implementations, frame-based camera data is obtained corresponding to light (e.g., visible light) reflected from the physical environment and received at a frame-based camera. In some implementations, a subset of the event camera data is identified based on the frame-based camera data, and a gesture (e.g., of a person in the physical environment) is identified based on the subset of event camera data. In some implementations, a path (e.g., of a hand) by tracking a grouping of blocks of event camera events in the subset of event camera data.

公开(公告)号：US20220139084A1

公开(公告)日：2022-05-05

申请号：US17579713

申请日：2022-01-20

Applicant: APPLE INC.

Inventor： Emanuele MANDELLI ,  Sai Harsha JANDHYALA ,  Walter NISTICO

IPC: G06V20/40 ,  G06V20/52 ,  G06F3/03 ,  G06F3/042

Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain information from a first electronic device (e.g., to improve interactions for a CGR environment). In some implementations at a second electronic device having a processor, event camera data is obtained corresponding to modulated light (e.g., light including an information signal in its modulation) emitted by an optical source on the first electronic device and received at an event camera. The second electronic device is able to identify information from the first electronic device based on detecting a modulation pattern of the modulated light based on the event camera data. In some implementations, second electronic device is the same electronic device that has the event camera (e.g., laptop) or a different electronic device that receives the event data (e.g., a server receiving the event data from a laptop computer).