Transmodal input fusion for a wearable system

    公开(公告)号:US10861242B2

    公开(公告)日:2020-12-08

    申请号:US16418820

    申请日:2019-05-21

    申请人: Magic Leap, Inc.

    摘要: Examples of wearable systems and methods can use multiple inputs (e.g., gesture, head pose, eye gaze, voice, totem, and/or environmental factors (e.g., location)) to determine a command that should be executed and objects in the three-dimensional (3D) environment that should be operated on. The wearable system can detect when different inputs converge together, such as when a user seeks to select a virtual object using multiple inputs such as eye gaze, head pose, hand gesture, and totem input. Upon detecting an input convergence, the wearable system can perform a transmodal filtering scheme that leverages the converged inputs to assist in properly interpreting what command the user is providing or what object the user is targeting.

    TRANSMODAL INPUT FUSION FOR A WEARABLE SYSTEM

    公开(公告)号:US20190362557A1

    公开(公告)日:2019-11-28

    申请号:US16418820

    申请日:2019-05-21

    申请人: Magic Leap, Inc.

    摘要: Examples of wearable systems and methods can use multiple inputs (e.g., gesture, head pose, eye gaze, voice, totem, and/or environmental factors (e.g., location)) to determine a command that should be executed and objects in the three-dimensional (3D) environment that should be operated on. The wearable system can detect when different inputs converge together, such as when a user seeks to select a virtual object using multiple inputs such as eye gaze, head pose, hand gesture, and totem input. Upon detecting an input convergence, the wearable system can perform a transmodal filtering scheme that leverages the converged inputs to assist in properly interpreting what command the user is providing or what object the user is targeting.