BIMANUAL INTERACTIONS BETWEEN MAPPED HAND REGIONS FOR CONTROLLING VIRTUAL AND GRAPHICAL ELEMENTS

    公开(公告)号:US20220326781A1

    公开(公告)日:2022-10-13

    申请号:US17714352

    申请日:2022-04-06

    Applicant: Snap Inc.

    Abstract: Example systems, devices, media, and methods are described for controlling the presentation of one or more virtual or graphical elements on a display in response to bimanual hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a first hand and defines a mapped region relative to a surface of the detected first hand. The system presents a virtual target icon at a position within or near the mapped region. The image processing system detects a series of bimanual hand shapes, including the detected first hand and at least one fingertip of a second hand. In response to determining whether the detected series of bimanual hand shapes matches a predefined hand gesture, the system executes a selecting action that includes presenting one or more graphical elements on the display.

Patent Agency Ranking