-
公开(公告)号:US20200273180A1
公开(公告)日:2020-08-27
申请号:US16761582
申请日:2018-11-13
Applicant: APPLE INC.
Inventor: Peter KAUFMANN , Daniel KURZ , Brian AMBERG , Yanghai TSIN
Abstract: Various implementations disclosed herein include devices, systems, and methods that use event camera data to track deformable objects such as faces, hands, and other body parts. One exemplary implementation involves receiving a stream of pixel events output by an event camera. The device tracks the deformable object using this data. Various implementations do so by generating a dynamic representation of the object and modifying the dynamic representation of the object in response to obtaining additional pixel events output by the event camera. In some implementations, generating the dynamic representation of the object involves identifying features disposed on the deformable surface of the object using the stream of pixel events. The features are determined by identifying patterns of pixel events. As new event stream data is received, the patterns of pixel events are recognized in the new data and used to modify the dynamic representation of the object.
-
公开(公告)号:US20230290084A1
公开(公告)日:2023-09-14
申请号:US18174560
申请日:2023-02-24
Applicant: Apple Inc.
Inventor: Daniel KURZ , Novaira MASOOD , Shem NGUYEN , Jeremy R. BERNSTEIN
CPC classification number: G06T19/006 , G06T19/003 , G06F3/011 , G06T15/50
Abstract: A computer-generated environment may include computer characters. Characteristics of the real-world environment are estimated and the interactions between computer characters and the real-world environment can be based on the estimated characteristics.
-
3.
公开(公告)号:US20240062346A1
公开(公告)日:2024-02-22
申请号:US18386086
申请日:2023-11-01
Applicant: APPLE INC.
Inventor: Peter MEIER , Daniel KURZ , Brian Chris CLARK , Mohamed Selim BEN HIMANE
CPC classification number: G06T5/005 , G06T7/75 , G06V10/60 , G06V40/171 , G06V20/10
Abstract: Various implementations disclosed herein include devices, systems, and methods that detect surfaces and reflections in such surfaces. Some implementations involve providing a CGR environment that includes virtual content that replaces the appearance of a user or the user's device in a mirror or other surface providing a reflection. For example, a CGR environment may be modified to include a reflection of the user that does not include the device that the user is holding or wearing. In another example, the CGR environment is modified so that virtual content, such as a newer version of the electronic device or a virtual wand, replaces the electronic device in the reflection. In another example, the CGR environment is modified so that virtual content, such as a user avatar, replaces the user in the reflection.
-
4.
公开(公告)号:US20230131109A1
公开(公告)日:2023-04-27
申请号:US17957416
申请日:2022-09-30
Applicant: APPLE INC.
Inventor: Peter MEIER , Daniel KURZ , Brian Chris CLARK , Mohamed Selim BEN HIMANE
Abstract: Various implementations disclosed herein include devices, systems, and methods that detect surfaces and reflections in such surfaces. Some implementations involve providing a CGR environment that includes virtual content that replaces the appearance of a user or the user's device in a mirror or other surface providing a reflection. For example, a CGR environment may be modified to include a reflection of the user that does not include the device that the user is holding or wearing. In another example, the CGR environment is modified so that virtual content, such as a newer version of the electronic device or a virtual wand, replaces the electronic device in the reflection. In another example, the CGR environment is modified so that virtual content, such as a user avatar, replaces the user in the reflection.
-
-
-