公开(公告)号：US20230160922A1

公开(公告)日：2023-05-25

申请号：US18158412

申请日：2023-01-23

Applicant: Apple Inc.

Inventor： Gierad LAPUT ,  Jared LeVan ZERBE ,  William C. ATHAS ,  Andreas Edgar SCHOBEL ,  Shawn R. SCULLY ,  Brian H. TSANG ,  Kevin LYNCH ,  Charles MAALOUF ,  Shiwen ZHAO

IPC: G01P15/18 ,  G01J1/42 ,  G01P13/00 ,  H04R1/08 ,  G10L25/51

CPC classification number: G01P15/18 ,  G01J1/4204 ,  G01P13/00 ,  H04R1/08 ,  G10L25/51

Abstract: Individual health related events (e.g., handwashing events) can be detected based on multiple sensors including motion and audio sensors. Detecting a qualifying handwashing event can include detecting a qualifying scrubbing event based on motion data (e.g., accelerometer data) and a qualifying rinsing event based on audio data. In some examples, power consumption can be reduced by implementing one or more power saving mitigations.

公开(公告)号：US20210142214A1

公开(公告)日：2021-05-13

申请号：US16937481

申请日：2020-07-23

Applicant: Apple Inc.

Inventor： Charles MAALOUF ,  Shawn R. SCULLY ,  Christopher B. FLEIZACH ,  Tu K. NGUYEN ,  Lilian H. LIANG ,  Warren J. SETO ,  Julian QUINTANA ,  Michael J. BEYHS ,  Hojjat SEYED MOUSAVI ,  Behrooz SHAHSAVARI

IPC: G06N20/00 ,  G06F3/01 ,  G06F3/0488 ,  G06K9/62

Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.

公开(公告)号：US20250037033A1

公开(公告)日：2025-01-30

申请号：US18915243

申请日：2024-10-14

Applicant: Apple Inc.

Inventor： Charles MAALOUF ,  Shawn R. SCULLY ,  Christopher B. FLEIZACH ,  Tu K. NGUYEN ,  Lilian H. LIANG ,  Warren J. SETO ,  Julian QUINTANA ,  Michael J. BEYHS ,  Hojjat SEYED MOUSAVI ,  Behrooz SHAHSAVARI

IPC: G06N20/00 ,  G06F3/01 ,  G06F3/04883 ,  G06F18/214 ,  G06N3/08

Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, sensor data for a first window of time and additional sensor data for a second window of time overlapping the first window of time. The sensor data and the additional sensor data are provided as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture, predicted gesture start time, and predicted gesture end time based on the sensor data. A predicted gesture is determined based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.

公开(公告)号：US20250004566A1

公开(公告)日：2025-01-02

申请号：US18751182

申请日：2024-06-21

Applicant: Apple Inc.

Inventor： Charles MAALOUF ,  Kaan E. DOGRUSOZ ,  Giovanni M. AGNOLI ,  Louis W. BOKMA ,  Adam J. LEONARD ,  Behrooz SHAHSAVARI ,  Yiqiang NIE ,  Hojjat Seyed MOUSAVI ,  Heriberto NIETO ,  Christopher M. SANDINO

IPC: G06F3/01 ,  G06N20/20

Abstract: Aspects of the subject technology provide improved gesture detection including collection of data from multiple sensors into a data structure that may be analyzed to estimate a plurality of gesture inferences, and then the plurality of gesture inferences may be integrated into a detected gesture for the period of time. Analysis of the data package may be performed by separate machine learning models, each model producing a corresponding gesture inference.

公开(公告)号：US20230325719A1

公开(公告)日：2023-10-12

申请号：US18202857

申请日：2023-05-26

Applicant: Apple Inc.

Inventor： Charles MAALOUF ,  Shawn R. SCULLY ,  Christopher B. FLEIZACH ,  Tu K. NGUYEN ,  Lilian H. LIANG ,  Warren J. SETO ,  Julian QUINTANA ,  Michael J. BEYHS ,  Hojjat SEYED MOUSAVI ,  Behrooz SHAHSAVARI

IPC: G06N20/00 ,  G06F3/01 ,  G06F3/04883 ,  G06F18/214

CPC classification number: G06N20/00 ,  G06F3/015 ,  G06F3/017 ,  G06F3/04883 ,  G06F18/2155 ,  G06N3/08

Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.

公开(公告)号：US20210063434A1

公开(公告)日：2021-03-04

申请号：US16994524

申请日：2020-08-14

Applicant: Apple Inc.

Inventor： Gierad LAPUT ,  Jared LeVan ZERBE ,  William C. ATHAS ,  Andreas Edgar SCHOBEL ,  Shawn R. SCULLY ,  Brian H. TSANG ,  Kevin LYNCH ,  Charles MAALOUF ,  Shiwen ZHAO

IPC: G01P15/18 ,  G01J1/42 ,  G01P13/00 ,  H04R1/08 ,  G10L25/51

Abstract: Individual health related events (e.g., handwashing events) can be detected based on multiple sensors including motion and audio sensors. Detecting a qualifying handwashing event can include detecting a qualifying scrubbing event based on motion data (e.g., accelerometer data) and a qualifying rinsing event based on audio data. In some examples, power consumption can be reduced by implementing one or more power saving mitigations.

公开(公告)号：US20240385691A1

公开(公告)日：2024-11-21

申请号：US18615715

申请日：2024-03-25

Applicant: Apple Inc.

Inventor： Yiqiang NIE ,  Kaan E. DOGRUSOZ ,  Charles MAALOUF ,  Elizabeth A. OTTENS ,  Brady J. QUIST

IPC: G06F3/01

Abstract: A computer system detects a gesture, such as an air gesture, and performs an operation based on the gesture.

公开(公告)号：US20240094819A1

公开(公告)日：2024-03-21

申请号：US18242694

申请日：2023-09-06

Applicant: Apple Inc.

Inventor： Yiqiang NIE ,  Giovanni M. AGNOLI ,  Allison W. DRYER ,  Jules K. FENNIS ,  Charles MAALOUF ,  Camille MOUSSETTE ,  Giancarlo YERKES

IPC: G06F3/01 ,  G06F3/04842

CPC classification number: G06F3/016 ,  G06F3/011 ,  G06F3/017 ,  G06F3/04842

Abstract: In some embodiments, the present disclosure includes techniques and user interfaces for performing operations using air gestures. In some embodiments, the present disclosure includes techniques and user interfaces for audio playback adjustment using gestures. In some embodiments, the present disclosure includes techniques and user interfaces for conditionally responding to inputs.

公开(公告)号：US20230376193A1

公开(公告)日：2023-11-23

申请号：US18197681

申请日：2023-05-15

Applicant: Apple Inc.

Inventor： Elizabeth HAN ,  Joanna ARREAZA-TAYLOR ,  Hannah G. COLEMAN ,  Caroline J. CRANDALL ,  Christopher B. FLEIZACH ,  Charles MAALOUF ,  Tu K. NGUYEN ,  Jennifer D. PATTON

IPC: G06F3/0488 ,  G06F3/14 ,  G06F3/0362 ,  G06F3/0485 ,  G06F9/451

CPC classification number: G06F3/0488 ,  G06F3/14 ,  G06F3/0362 ,  G06F3/0485 ,  G06F9/451

Abstract: The present disclosure generally relates to displaying user interfaces with device controls.

公开(公告)号：US20220351086A1

公开(公告)日：2022-11-03

申请号：US17869740

申请日：2022-07-20

Applicant: Apple Inc.

Inventor： Charles MAALOUF ,  Shawn R. SCULLY ,  Christopher B. FLEIZACH ,  Tu K. NGUYEN ,  Lilian H. LIANG ,  Warren J. SETO ,  Julian QUINTANA ,  Michael J. BEYHS ,  Hojjat SEYED MOUSAVI ,  Behrooz SHAHSAVARI

IPC: G06N20/00 ,  G06F3/01 ,  G06F3/04883 ,  G06K9/62

Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.