DEFORMABLE OBJECT TRACKING
    1.
    发明申请

    公开(公告)号:US20200273180A1

    公开(公告)日:2020-08-27

    申请号:US16761582

    申请日:2018-11-13

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that use event camera data to track deformable objects such as faces, hands, and other body parts. One exemplary implementation involves receiving a stream of pixel events output by an event camera. The device tracks the deformable object using this data. Various implementations do so by generating a dynamic representation of the object and modifying the dynamic representation of the object in response to obtaining additional pixel events output by the event camera. In some implementations, generating the dynamic representation of the object involves identifying features disposed on the deformable surface of the object using the stream of pixel events. The features are determined by identifying patterns of pixel events. As new event stream data is received, the patterns of pixel events are recognized in the new data and used to modify the dynamic representation of the object.

    IMAGE-BASED DETECTION OF SURFACES THAT PROVIDE SPECULAR REFLECTIONS AND REFLECTION MODIFICATION

    公开(公告)号:US20230131109A1

    公开(公告)日:2023-04-27

    申请号:US17957416

    申请日:2022-09-30

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that detect surfaces and reflections in such surfaces. Some implementations involve providing a CGR environment that includes virtual content that replaces the appearance of a user or the user's device in a mirror or other surface providing a reflection. For example, a CGR environment may be modified to include a reflection of the user that does not include the device that the user is holding or wearing. In another example, the CGR environment is modified so that virtual content, such as a newer version of the electronic device or a virtual wand, replaces the electronic device in the reflection. In another example, the CGR environment is modified so that virtual content, such as a user avatar, replaces the user in the reflection.

Patent Agency Ranking