公开(公告)号：US20240004476A1

公开(公告)日：2024-01-04

申请号：US17809772

申请日：2022-06-29

Applicant: GOOGLE LLC

Inventor： Dongeek Shin ,  Andrea Colaco ,  Stiven Guillaume Francois Morvan ,  Adam James Banfield ,  Shahram Izadi

IPC: G06F3/01 ,  G06V40/20 ,  G06V40/10 ,  G06V40/13 ,  G06V20/20 ,  G06V10/82 ,  G06F1/16

CPC classification number: G06F3/017 ,  G06V40/28 ,  G06V40/15 ,  G06V40/1318 ,  G06V20/20 ,  G06V10/82 ,  G06F1/163

Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.

公开(公告)号：US20240338084A1

公开(公告)日：2024-10-10

申请号：US18440605

申请日：2024-02-13

Applicant: GOOGLE LLC

Inventor： Dongeek Shin ,  Andrea Colaco ,  Stiven Guillaume Francois Morvan ,  Adam James Banfield ,  Shahram Izadi

IPC: G06F3/01 ,  G06F1/16 ,  G06V10/82 ,  G06V20/20 ,  G06V40/10 ,  G06V40/13 ,  G06V40/20

CPC classification number: G06F3/017 ,  G06F1/163 ,  G06V10/82 ,  G06V20/20 ,  G06V40/1318 ,  G06V40/15 ,  G06V40/28

Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.

公开(公告)号：US11934586B2

公开(公告)日：2024-03-19

申请号：US17809772

申请日：2022-06-29

Applicant: GOOGLE LLC

Inventor： Dongeek Shin ,  Andrea Colaco ,  Stiven Guillaume Francois Morvan ,  Adam James Banfield ,  Shahram Izadi

IPC: G06V40/10 ,  G06F1/16 ,  G06F3/01 ,  G06V10/82 ,  G06V20/20 ,  G06V40/13 ,  G06V40/20

CPC classification number: G06F3/017 ,  G06F1/163 ,  G06V10/82 ,  G06V20/20 ,  G06V40/1318 ,  G06V40/15 ,  G06V40/28

Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.

公开(公告)号：US20240201792A1

公开(公告)日：2024-06-20

申请号：US18537224

申请日：2023-12-12

Applicant: GOOGLE LLC

Inventor： Stiven Guillaume Francois Morvan ,  Dongeek Shin ,  Andrea Colaco ,  Sambuddha Basu ,  Sean Kyungmok Bae ,  Junyi Zhu

IPC: G06F3/01 ,  A61B5/0536 ,  A61B5/263 ,  G06V10/12 ,  G06V10/764 ,  G06V40/20

CPC classification number: G06F3/017 ,  A61B5/0536 ,  A61B5/263 ,  G06V10/12 ,  G06V10/764 ,  G06V40/28

Abstract: Techniques include determining hand gestures formed by a user based on an electrical impedance tomograph of the wrist. For example, a user may be outfitted with a flexible wristband that fits snugly around the wrist and contains a plurality of electrodes, e.g., 32 electrodes. When a current is applied to a first subset of the electrodes, e.g., two of 32 electrodes, the electric field induced through at least one cross-section of the wrist will in turn induce a voltage across adjacent pairs of a second subset of the electrodes (e.g., the other 30 of 32 electrodes). From this current and induced voltage, one may use techniques of electrical impedance tomography (EIT) to determine the electrical impedance throughout the at least one cross-section of the wrist, e.g., in an electrical impedance tomograph. One may use a neural network to map the electrical impedance tomograph to a hand gesture.

公开(公告)号：US12072501B1

公开(公告)日：2024-08-27

申请号：US18168770

申请日：2023-02-14

Applicant: GOOGLE LLC

Inventor： Stiven Guillaume Francois Morvan ,  Dongeek Shin ,  Konstantine Nicholas John Tsotsos ,  Li-Te Cheng

IPC: G09G3/00 ,  G02B27/01

CPC classification number: G02B27/0172 ,  G02B27/0179 ,  G02B2027/0178

Abstract: A head-mounted device may present a first user interface element and a second user interface element within a user interface that is included in a display of the head-mounted device. The head-mounted device may, in response to movement of the head-mounted device, move the first user interface element and the second user interface element within the display, the movement of the first user interface element decreasing a boundary distance below a threshold distance, the boundary distance being based on a distance between the first user interface element and a boundary associated with the user interface. The head-mounted device may decrease a size of the first user interface element while the boundary distance is decreasing and is below the threshold distance.

公开(公告)号：US20240272433A1

公开(公告)日：2024-08-15

申请号：US18168770

申请日：2023-02-14

Applicant: GOOGLE LLC

Inventor： Stiven Guillaume Francois Morvan ,  Dongeek Shin ,  Konstantine Nicholas John Tsotsos ,  Li-Te Cheng

IPC: G02B27/01

CPC classification number: G02B27/0172 ,  G02B27/0179 ,  G02B2027/0178

Abstract: A head-mounted device may present a first user interface element and a second user interface element within a user interface that is included in a display of the head-mounted device. The head-mounted device may, in response to movement of the head-mounted device, move the first user interface element and the second user interface element within the display, the movement of the first user interface element decreasing a boundary distance below a threshold distance, the boundary distance being based on a distance between the first user interface element and a boundary associated with the user interface. The head-mounted device may decrease a size of the first user interface element while the boundary distance is decreasing and is below the threshold distance.