-
1.
公开(公告)号:US20220391697A1
公开(公告)日:2022-12-08
申请号:US17740291
申请日:2022-05-09
申请人: Apple Inc.
IPC分类号: G06N3/08 , G06F1/16 , G06F3/01 , G06F3/0346
摘要: Embodiments are disclosed for a machine learning (ML) gesture recognition with a framework for adding user-customized gestures. In an embodiment, a method comprises: receiving sensor data indicative of a gesture made by a user, the sensor data obtained from at least one sensor of a wearable device worn on a limb of the user; generating a current encoding of features extracted from the sensor data using a machine learning model with the features as input; generating similarity metrics between the current encoding and each encoding in a set of previously generated encodings for gestures; generating similarity scores based on the similarity metrics; predicting the gesture made by the user based on the similarity scores; and performing an action on the wearable device or other device based on the predicted gesture.
-
公开(公告)号:US11907436B2
公开(公告)日:2024-02-20
申请号:US17946959
申请日:2022-09-16
申请人: Apple Inc.
发明人: Stephen O. Lemay , Michael R. Bastian , Roman Holenstein , Minwoo Jeong , Charles Maalouf , Brandon J. Newendorp , Heriberto Nieto , Timothy Paek , Joanna Peterson , Shawn Scully , Srikrishna Sridhar , Brandt M. Westing , Shiwen Zhao
IPC分类号: G06F3/01 , G06F1/16 , G06F1/3206 , G06F3/0346 , G06F3/16 , G10L15/07
CPC分类号: G06F3/017 , G06F1/163 , G06F1/3206 , G06F3/016 , G06F3/0346 , G06F3/167 , G10L15/07
摘要: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.
-
公开(公告)号:US11699104B2
公开(公告)日:2023-07-11
申请号:US17869740
申请日:2022-07-20
申请人: Apple Inc.
发明人: Charles Maalouf , Shawn R. Scully , Christopher B. Fleizach , Tu K. Nguyen , Lilian H. Liang , Warren J. Seto , Julian Quintana , Michael J. Beyhs , Hojjat Seyed Mousavi , Behrooz Shahsavari
IPC分类号: G06V10/00 , G06N20/00 , G06F3/01 , G06F3/04883 , G06F18/214 , G06N3/08
CPC分类号: G06N20/00 , G06F3/015 , G06F3/017 , G06F3/04883 , G06F18/2155 , G06N3/08
摘要: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
-
公开(公告)号:US12118443B2
公开(公告)日:2024-10-15
申请号:US18202857
申请日:2023-05-26
申请人: Apple Inc.
发明人: Charles Maalouf , Shawn R. Scully , Christopher B. Fleizach , Tu K. Nguyen , Lilian H. Liang , Warren J. Seto , Julian Quintana , Michael J. Beyhs , Hojjat Seyed Mousavi , Behrooz Shahsavari
IPC分类号: G06V10/00 , G06F3/01 , G06F3/04883 , G06F18/214 , G06N20/00 , G06N3/08
CPC分类号: G06N20/00 , G06F3/015 , G06F3/017 , G06F3/04883 , G06F18/2155 , G06N3/08
摘要: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
-
公开(公告)号:US11449802B2
公开(公告)日:2022-09-20
申请号:US16937481
申请日:2020-07-23
申请人: Apple Inc.
发明人: Charles Maalouf , Shawn R. Scully , Christopher B. Fleizach , Tu K. Nguyen , Lilian H. Liang , Warren J. Seto , Julian Quintana , Michael J. Beyhs , Hojjat Seyed Mousavi , Behrooz Shahsavari
摘要: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
-
公开(公告)号:US11639944B2
公开(公告)日:2023-05-02
申请号:US16994524
申请日:2020-08-14
申请人: Apple Inc.
发明人: Gierad Laput , Jared LeVan Zerbe , William C. Athas , Andreas Edgar Schobel , Shawn R. Scully , Brian H. Tsang , Kevin Lynch , Charles Maalouf , Shiwen Zhao
摘要: Individual health related events (e.g., handwashing events) can be detected based on multiple sensors including motion and audio sensors. Detecting a qualifying handwashing event can include detecting a qualifying scrubbing event based on motion data (e.g., accelerometer data) and a qualifying rinsing event based on audio data. In some examples, power consumption can be reduced by implementing one or more power saving mitigations.
-
公开(公告)号:US11487364B2
公开(公告)日:2022-11-01
申请号:US17489307
申请日:2021-09-29
申请人: Apple Inc.
发明人: Stephen O. Lemay , Michael R. Bastian , Roman Holenstein , Minwoo Jeong , Charles Maalouf , Brandon J. Newendorp , Heriberto Nieto , Timothy Paek , Joanna Peterson , Shawn Scully , Srikrishna Sridhar , Brandt M. Westing , Shiwen Zhao
IPC分类号: G06F3/01 , G06F1/16 , G06F1/32 , G06F3/0346 , G06F3/16 , G06F1/3206 , G10L15/07
摘要: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.
-
公开(公告)号:US10928918B2
公开(公告)日:2021-02-23
申请号:US16032487
申请日:2018-07-11
申请人: Apple Inc.
发明人: Stephen O. Lemay , Michael R. Bastian , Roman Holenstein , Minwoo Jeong , Charles Maalouf , Brandon J. Newendorp , Heriberto Nieto , Timothy Paek , Joanna Peterson , Shawn Scully , Srikrishna Sridhar , Brandt M. Westing , Shiwen Zhao
IPC分类号: G06F3/01 , G06F1/16 , G06F1/32 , G06F3/0346 , G06F3/16 , G10L15/07 , G06F1/3206
摘要: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.
-
公开(公告)号:US20240103633A1
公开(公告)日:2024-03-28
申请号:US18370837
申请日:2023-09-20
申请人: Apple Inc.
发明人: Bongsoo Suh , Behrooz Shahsavari , Charles Maalouf , Hojjat Seyed Mousavi , Laurence Lindsey , Shivam Kumar Gupta
IPC分类号: G06F3/01 , G06N3/0464
CPC分类号: G06F3/017 , G06N3/0464
摘要: Embodiments are disclosed for hold gesture recognition using machine learning (ML). In an embodiment, a method comprises: receiving sensor signals indicative of a hand gesture made by a user, the sensor data obtained from at least one sensor of a wearable device worn by the user; generating a first embedding of first features extracted from the sensor signals; predicting a first part of a hold gesture based on a first ML gesture classifier and the first embedding; generating a second embedding of second features extracted from the sensor signals; predicting a second part of the hold gesture based on a second ML gesture classifier and the second embedding; predicting a hold gesture based at least in part on outputs of the first and second ML gesture classifiers and a prediction policy; and performing an action on the wearable device or other device based on the predicted hold gesture.
-
公开(公告)号:US11561239B2
公开(公告)日:2023-01-24
申请号:US16994524
申请日:2020-08-14
申请人: Apple Inc.
发明人: Gierad Laput , Jared LeVan Zerbe , William C. Athas , Andreas Edgar Schobel , Shawn R. Scully , Brian H. Tsang , Kevin Lynch , Charles Maalouf , Shiwen Zhao
摘要: Individual health related events (e.g., handwashing events) can be detected based on multiple sensors including motion and audio sensors. Detecting a qualifying handwashing event can include detecting a qualifying scrubbing event based on motion data (e.g., accelerometer data) and a qualifying rinsing event based on audio data. In some examples, power consumption can be reduced by implementing one or more power saving mitigations.
-
-
-
-
-
-
-
-
-