公开(公告)号：US20220300085A1

公开(公告)日：2022-09-22

申请号：US17833556

申请日：2022-06-06

申请人： Ultrahaptics IP Two Limited

发明人： Raffi BEDIKIAN ,  Jonathan MARSDEN ,  Keith MERTENS ,  David HOLZ

IPC分类号： G06F3/01 ,  G06F3/03 ,  G06V40/20 ,  G06F3/04845

摘要： During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.

公开(公告)号：US20240061511A1

公开(公告)日：2024-02-22

申请号：US18219517

申请日：2023-07-07

申请人： Ultrahaptics IP Two Limited

发明人： Raffi BEDIKIAN ,  Jonathan MARSDEN ,  Keith MERTENS ,  David HOLZ ,  Maxwell SILLS ,  Matias PEREZ ,  Gabriel HARE ,  Ryan JULIAN

IPC分类号： G06F3/01 ,  G06F3/04815 ,  G06F3/03 ,  G06V40/20

CPC分类号： G06F3/017 ,  G06F3/04815 ,  G06F3/0325 ,  G06V40/20

摘要： Embodiments of display control based on dynamic user interactions generally include capturing a plurality of temporally sequential images of the user, or a body part or other control object manipulated by the user, and computationally analyzing the images to recognize a gesture performed by the user. In some embodiments, the gesture is identified as an engagement gesture, and compared with reference gestures from a library of reference gestures. In some embodiments, a degree of completion of the recognized engagement gesture is determined, and the display contents are modified in accordance therewith. In some embodiments, a dominant gesture is computationally determined from among a plurality of user gestures, and an action displayed on the device is based on the dominant gesture.

公开(公告)号：US20230161415A1

公开(公告)日：2023-05-25

申请号：US18094272

申请日：2023-01-06

申请人： Ultrahaptics IP Two Limited

发明人： Hua YANG ,  Leonid KONTSEVICH ,  James DONALD ,  David S. HOLZ ,  Jonathan MARSDEN ,  Paul DURDIK

IPC分类号： G06F3/01 ,  G06T19/00 ,  G06F3/04815 ,  G06F3/0486

CPC分类号： G06F3/017 ,  G06T19/006 ,  G06F3/04815 ,  G06F3/0486 ,  G06F3/011 ,  G06F3/0346

摘要： During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its contact with a “virtual touch plane or surface” (i.e., a plane, portion of a plane, and/or surface computationally defined in space, or corresponding to any physical surface).

公开(公告)号：US20240077950A1

公开(公告)日：2024-03-07

申请号：US18506009

申请日：2023-11-09

申请人： Ultrahaptics IP Two Limited

发明人： Raffi BEDIKIAN ,  Jonathan MARSDEN ,  Keith MERTENS ,  David HOLZ

IPC分类号： G06F3/01 ,  G06F3/03 ,  G06F3/04845 ,  G06V40/20

CPC分类号： G06F3/017 ,  G06F3/011 ,  G06F3/0304 ,  G06F3/04845 ,  G06V40/20

摘要： During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The technology disclosed includes determining from the motion information whether a motion of the control object with respect to the virtual control construct is an engagement gesture, such as a virtual mouse click or other control device operation. The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.

公开(公告)号：US20230214458A1

公开(公告)日：2023-07-06

申请号：US16508231

申请日：2019-07-10

申请人： Ultrahaptics IP Two Limited

发明人： Jonathan MARSDEN ,  Raffi BEDIKIAN ,  David Samuel HOLZ

IPC分类号： G06K9/62 ,  G06K9/00 ,  G06K9/46 ,  G06T7/13

CPC分类号： G06K9/6269 ,  G06K9/00355 ,  G06K9/4604 ,  G06T7/13 ,  G06T2207/10028

摘要： The technology disclosed performs hand pose estimation on a so-called “joint-by-joint” basis. So, when a plurality of estimates for the 28 hand joints are received from a plurality of expert networks (and from master experts in some high-confidence scenarios), the estimates are analyzed at a joint level and a final location for each joint is calculated based on the plurality of estimates for a particular joint. This is a novel solution discovered by the technology disclosed because nothing in the field of art determines hand pose estimates at such granularity and precision. Regarding granularity and precision, because hand pose estimates are computed on a joint-by joint basis, this allows the technology disclosed to detect in real time even the minutest and most subtle hand movements, such a bend/yaw/tilt/roll of a segment of a finger or a tilt an occluded finger, as demonstrated supra in the Experimental Results section of this application.