公开(公告)号：US20220334649A1

公开(公告)日：2022-10-20

申请号：US17719654

申请日：2022-04-13

Applicant: Snap Inc.

Inventor： Viktoria Hwang ,  Karen Stolzenberg

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/04817 ,  G06F3/0482 ,  G06V40/20 ,  G06V40/10 ,  G06V20/40 ,  G02B27/01

Abstract: Example systems, devices, media, and methods are described for controlling one or more virtual elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a hand and presents a menu icon on the display in accordance with a detected current hand location. The image processing system detects a series of hand shapes in the captured frames of video data and determines whether the detected hand shapes match any of a plurality of predefined hand gestures stored in a hand gesture library. In response to a match, the method includes executing an action in accordance with the matching hand gesture. In response to an opening gesture, an element animation system presents one or more graphical elements incrementally moving along a path extending away from the menu icon. A closing hand gesture causes the elements to retreat along the path toward the menu icon.

公开(公告)号：US11861070B2

公开(公告)日：2024-01-02

申请号：US17719654

申请日：2022-04-13

Applicant: Snap Inc.

Inventor： Viktoria Hwang ,  Karen Stolzenberg

IPC: G06F3/04815 ,  G06F3/01 ,  G06V40/10 ,  G06V20/40 ,  G06V40/20 ,  G02B27/01 ,  G06F3/04817 ,  G06F3/0482

CPC classification number: G06F3/017 ,  G02B27/0101 ,  G02B27/017 ,  G06F3/011 ,  G06F3/0482 ,  G06F3/04815 ,  G06F3/04817 ,  G06V20/46 ,  G06V40/113 ,  G06V40/28 ,  G02B2027/014 ,  G02B2027/0138 ,  G02B2027/0178

Abstract: Example systems, devices, media, and methods are described for controlling one or more virtual elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a hand and presents a menu icon on the display in accordance with a detected current hand location. The image processing system detects a series of hand shapes in the captured frames of video data and determines whether the detected hand shapes match any of a plurality of predefined hand gestures stored in a hand gesture library. In response to a match, the method includes executing an action in accordance with the matching hand gesture. In response to an opening gesture, an element animation system presents one or more graphical elements incrementally moving along a path extending away from the menu icon. A closing hand gesture causes the elements to retreat along the path toward the menu icon.

公开(公告)号：US12141367B2

公开(公告)日：2024-11-12

申请号：US18386868

申请日：2023-11-03

Applicant: Snap Inc.

Inventor： Viktoria Hwang ,  Karen Stolzenberg

IPC: G06F3/0482 ,  G02B27/01 ,  G06F3/01 ,  G06F3/04815 ,  G06F3/04817 ,  G06V20/40 ,  G06V40/10 ,  G06V40/20

Abstract: Example systems, devices, media, and methods are described for controlling one or more virtual elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a hand and presents a menu icon on the display in accordance with a detected current hand location. The image processing system detects a series of hand shapes in the captured frames of video data and determines whether the detected hand shapes match any of a plurality of predefined hand gestures stored in a hand gesture library. In response to a match, the method includes executing an action in accordance with the matching hand gesture. In response to an opening gesture, an element animation system presents one or more graphical elements incrementally moving along a path extending away from the menu icon. A closing hand gesture causes the elements to retreat along the path toward the menu icon.

公开(公告)号：US20240393887A1

公开(公告)日：2024-11-28

申请号：US18797805

申请日：2024-08-08

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Viktoria Hwang ,  Shin Hwun Kang ,  David Meisenholder ,  Daniel Moreno

IPC: G06F3/01 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04847 ,  G06T19/00 ,  G06V20/40 ,  G06V40/10 ,  G06V40/20

Abstract: Example systems, devices, media, and methods are described for controlling virtual elements or graphical elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a series of hand shapes in the video data and determines whether it matches a predefined series of hand gestures. Each predefined series of hand gestures is associated with an action. The system controls movement of the virtual element, relative to the display, in accordance with the associated action. In an example hand shape that includes a thumb sliding along an extended finger, the system establishes a finger scale along the extended finger, calibrates a graphical scale with the finger scale, and controls movement of an interactive graphical element, such as a slider, according to the current thumb position relative to the calibrated graphical scale.

公开(公告)号：US20250021170A1

公开(公告)日：2025-01-16

申请号：US18903856

申请日：2024-10-01

Applicant: Snap Inc.

Inventor： Viktoria Hwang ,  Karen Stolzenberg

IPC: G06F3/01 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04817 ,  G06F3/0482 ,  G06V20/40 ,  G06V40/10 ,  G06V40/20

Abstract: Examples are described for controlling virtual elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a hand and presents a menu icon on the display in accordance with a detected current hand location. The image processing system detects a series of hand shapes in the captured frames of video data and determines whether the detected hand shapes match any of a plurality of predefined hand gestures stored in a hand gesture library. If a match, an action executes in accordance with the matching hand gesture. In response to an opening gesture, an element animation system presents one or more graphical elements incrementally moving along a path extending away from the menu icon. A closing hand gesture causes the elements to retreat along the path toward the menu icon.

公开(公告)号：US12086324B2

公开(公告)日：2024-09-10

申请号：US17550679

申请日：2021-12-14

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Viktoria Hwang ,  Shin Hwun Kang ,  David Meisenholder ,  Daniel Moreno

IPC: G06F3/04815 ,  G02B27/01 ,  G06F3/01 ,  G06F3/04847 ,  G06T19/00 ,  G06V20/40 ,  G06V40/10 ,  G06V40/20

CPC classification number: G06F3/017 ,  G02B27/0101 ,  G02B27/017 ,  G06F3/04815 ,  G06F3/04847 ,  G06T19/006 ,  G06V20/46 ,  G06V40/113 ,  G06V40/28 ,  G02B2027/0138 ,  G02B2027/0178

Abstract: Example systems, devices, media, and methods are described for controlling virtual elements or graphical elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a series of hand shapes in the video data and determines whether it matches a predefined series of hand gestures. Each predefined series of hand gestures is associated with an action. The system controls movement of the virtual element, relative to the display, in accordance with the associated action. In an example hand shape that includes a thumb sliding along an extended finger, the system establishes a finger scale along the extended finger, calibrates a graphical scale with the finger scale, and controls movement of an interactive graphical element, such as a slider, according to the current thumb position relative to the calibrated graphical scale.

公开(公告)号：US20240061515A1

公开(公告)日：2024-02-22

申请号：US18386868

申请日：2023-11-03

Applicant: Snap Inc.

Inventor： Viktoria Hwang ,  Karen Stolzenberg

IPC: G06F3/01 ,  G06V40/10 ,  G06V20/40 ,  G06V40/20 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04817 ,  G06F3/0482

CPC classification number: G06F3/017 ,  G06V40/113 ,  G06V20/46 ,  G06V40/28 ,  G02B27/0101 ,  G02B27/017 ,  G06F3/011 ,  G06F3/04815 ,  G06F3/04817 ,  G06F3/0482 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178

Abstract: Example systems, devices, media, and methods are described for controlling one or more virtual elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a hand and presents a menu icon on the display in accordance with a detected current hand location. The image processing system detects a series of hand shapes in the captured frames of video data and determines whether the detected hand shapes match any of a plurality of predefined hand gestures stored in a hand gesture library. In response to a match, the method includes executing an action in accordance with the matching hand gesture. In response to an opening gesture, an element animation system presents one or more graphical elements incrementally moving along a path extending away from the menu icon. A closing hand gesture causes the elements to retreat along the path toward the menu icon.

公开(公告)号：US20220326781A1

公开(公告)日：2022-10-13

申请号：US17714352

申请日：2022-04-06

Applicant: Snap Inc.

Inventor： Viktoria Hwang ,  Karen Stolzenberg

IPC: G06F3/01 ,  G06V40/10 ,  G06T7/70 ,  G06T19/00

Abstract: Example systems, devices, media, and methods are described for controlling the presentation of one or more virtual or graphical elements on a display in response to bimanual hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a first hand and defines a mapped region relative to a surface of the detected first hand. The system presents a virtual target icon at a position within or near the mapped region. The image processing system detects a series of bimanual hand shapes, including the detected first hand and at least one fingertip of a second hand. In response to determining whether the detected series of bimanual hand shapes matches a predefined hand gesture, the system executes a selecting action that includes presenting one or more graphical elements on the display.

公开(公告)号：US20220206588A1

公开(公告)日：2022-06-30

申请号：US17550679

申请日：2021-12-14

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Viktoria Hwang ,  Shin Hwun Kang ,  David Meisenholder ,  Daniel Moreno

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/04847 ,  G06V40/20 ,  G06V40/10 ,  G06V20/40 ,  G02B27/01 ,  G06T19/00

Abstract: Example systems, devices, media, and methods are described for controlling virtual elements or graphical elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a series of hand shapes in the video data and determines whether it matches a predefined series of hand gestures. Each predefined series of hand gestures is associated with an action. The system controls movement of the virtual element, relative to the display, in accordance with the associated action. In an example hand shape that includes a thumb sliding along an extended finger, the system establishes a finger scale along the extended finger, calibrates a graphical scale with the finger scale, and controls movement of an interactive graphical element, such as a slider, according to the current thumb position relative to the calibrated graphical scale.