公开(公告)号：US11550469B2

公开(公告)日：2023-01-10

申请号：US17183998

申请日：2021-02-24

Applicant: Da-Yuan Huang ,  Wei Li ,  Pourang Polad Irani

Inventor： Da-Yuan Huang ,  Wei Li ,  Pourang Polad Irani

IPC: G06F3/04883 ,  G06F3/041 ,  G06F3/0483 ,  G06F3/0485 ,  G06F3/01

Abstract: Devices, methods and systems for controlling an electronic device using force-based gestures are described. Force data from one or more force sensors, representing a force input to the electronic device, is monitored to determine any force data exceeding a defined first magnitude threshold. In response to determining force data from at least one force sensor exceeding the first magnitude threshold, an edge location or a corner location of the force input is determined. The force input is processed as a force gesture in accordance with the determined edge location or the determined corner location. Haptic feedback is generated concurrently with processing the force gesture.

公开(公告)号：US20210081052A1

公开(公告)日：2021-03-18

申请号：US17024633

申请日：2020-09-17

Applicant: Gaganpreet SINGH ,  Rafael VERAS GUIMARAES ,  Wei ZHOU ,  Pourang Polad IRANI ,  Farzin FARHADI-NIAKI ,  Wei LI

Inventor： Gaganpreet SINGH ,  Rafael VERAS GUIMARAES ,  Wei ZHOU ,  Pourang Polad IRANI ,  Farzin FARHADI-NIAKI ,  Wei LI

IPC: G06F3/01 ,  G06K9/00

Abstract: User interface control based on elbow-anchored arm gestures is disclosed. In one aspect, there is provided a method of user interface control on a computing device based on elbow-anchored arm gestures. A visual user interface (VUI) screen is displayed on a display of a computing device. The VUI screen comprises a plurality of VUI elements arranged in a plurality of VUI element levels. Each VUI element level comprising one or more VUI elements. A spatial location of an elbow of an arm of a user and a spatial location of a wrist of the arm of the user are determined. A three-dimensional (3D) arm vector extending from the spatial location of the elbow to the spatial location of the wrist is then determined. A VUI element in the VUI screen corresponding to the 3D arm vector is then determined based on a predetermined 3D spatial mapping between 3D arm vectors and VUI elements for the VUI screen.

公开(公告)号：US11662822B1

公开(公告)日：2023-05-30

申请号：US17555880

申请日：2021-12-20

Applicant: Da Yuan Huang ,  Wei Li ,  Pourang Polad Irani ,  Alice Jing Fei Liang ,  Yukun Zhang ,  Qing Liu

Inventor： Da Yuan Huang ,  Wei Li ,  Pourang Polad Irani ,  Alice Jing Fei Liang ,  Yukun Zhang ,  Qing Liu

IPC: G06F3/01 ,  G06F3/04883 ,  G06F3/041

CPC classification number: G06F3/016 ,  G06F3/017 ,  G06F3/041 ,  G06F3/04883 ,  G06F2203/04105

Abstract: Systems and methods for generating pseudo haptic feedback for a virtual widget are disclosed. The method includes computing, from a force profile of the virtual widget, a virtual displacement value based on a force value and a type of the virtual widget. The force profile describes a user's perception of physical characteristics of the virtual widget. The method generates a visual haptic feedback based on the virtual displacement value and the type of the virtual widget. Further, in response to the force value, the method may display on a display screen the visual haptic feedback.

公开(公告)号：US20230145592A1

公开(公告)日：2023-05-11

申请号：US17523267

申请日：2021-11-10

Applicant: Gaganpreet SINGH ,  Wei ZHOU ,  Pourang Polad IRANI ,  Wei LI

Inventor： Gaganpreet SINGH ,  Wei ZHOU ,  Pourang Polad IRANI ,  Wei LI

IPC: G06F3/01 ,  G06F3/03 ,  G06K9/00 ,  H04N21/422 ,  H04N21/472

CPC classification number: G06F3/017 ,  G06F3/0304 ,  G06K9/00355 ,  G06K9/00375 ,  G06K9/00744 ,  H04N21/42204 ,  H04N21/47205

Abstract: Method and systems for controlling a display device, including detecting a mid-air gesture using a sensing device; mapping the detected mid-air gesture to locations of an interaction region, the interaction region including an on-screen region of the display device and an off-screen region that is located outside an edge of the on-screen region; and performing a display device control action upon detecting an edge interaction based on the mapping of the detected mid-air gesture to locations that interact with the edge of the on-screen region.

公开(公告)号：US20220269404A1

公开(公告)日：2022-08-25

申请号：US17183998

申请日：2021-02-24

Applicant: Da-Yuan HUANG ,  Wei Li ,  Pourang Polad IRANI

Inventor： Da-Yuan HUANG ,  Wei Li ,  Pourang Polad IRANI

IPC: G06F3/0488 ,  G06F3/041 ,  G06F3/01 ,  G06F3/0485 ,  G06F3/0483

Abstract: Devices, methods and systems for controlling an electronic device using force-based gestures are described. Force data from one or more force sensors, representing a force input to the electronic device, is monitored to determine any force data exceeding a defined first magnitude threshold. In response to determining force data from at least one force sensor exceeding the first magnitude threshold, an edge location or a corner location of the force input is determined. The force input is processed as a force gesture in accordance with the determined edge location or the determined corner location. Haptic feedback is generated concurrently with processing the force gesture.

公开(公告)号：US11693483B2

公开(公告)日：2023-07-04

申请号：US17523267

申请日：2021-11-10

Applicant: Gaganpreet Singh ,  Wei Zhou ,  Pourang Polad Irani ,  Wei Li

Inventor： Gaganpreet Singh ,  Wei Zhou ,  Pourang Polad Irani ,  Wei Li

IPC: G06F3/01 ,  G06F3/03 ,  H04N21/472 ,  H04N21/422 ,  G06V20/40 ,  G06V40/20 ,  G06V40/10

CPC classification number: G06F3/017 ,  G06F3/0304 ,  G06V20/46 ,  G06V40/107 ,  G06V40/28 ,  H04N21/42204 ,  H04N21/47205

Abstract: Method and systems for controlling a display device, including detecting a mid-air gesture using a sensing device; mapping the detected mid-air gesture to locations of an interaction region, the interaction region including an on-screen region of the display device and an off-screen region that is located outside an edge of the on-screen region; and performing a display device control action upon detecting an edge interaction based on the mapping of the detected mid-air gesture to locations that interact with the edge of the on-screen region.

公开(公告)号：US11301049B2

公开(公告)日：2022-04-12

申请号：US17024633

申请日：2020-09-17

Applicant: Gaganpreet Singh ,  Rafael Veras Guimaraes ,  Wei Zhou ,  Pourang Polad Irani ,  Farzin Farhadi-Niaki ,  Wei Li

Inventor： Gaganpreet Singh ,  Rafael Veras Guimaraes ,  Wei Zhou ,  Pourang Polad Irani ,  Farzin Farhadi-Niaki ,  Wei Li

IPC: G06F3/01 ,  G06K9/00 ,  G06F17/16

Abstract: User interface control based on elbow-anchored arm gestures is disclosed. In one aspect, there is provided a method of user interface control on a computing device based on elbow-anchored arm gestures. A visual user interface (VUI) screen is displayed on a display of a computing device. The VUI screen comprises a plurality of VUI elements arranged in a plurality of VUI element levels. Each VUI element level comprising one or more VUI elements. A spatial location of an elbow of an arm of a user and a spatial location of a wrist of the arm of the user are determined. A three-dimensional (3D) arm vector extending from the spatial location of the elbow to the spatial location of the wrist is then determined. A VUI element in the VUI screen corresponding to the 3D arm vector is then determined based on a predetermined 3D spatial mapping between 3D arm vectors and VUI elements for the VUI screen.

公开(公告)号：US10684768B2

公开(公告)日：2020-06-16

申请号：US13274253

申请日：2011-10-14

Applicant: Tovi Grossman ,  George Fitzmaurice ,  Xing-Dong Yang ,  Pourang Polad Irani

Inventor： Tovi Grossman ,  George Fitzmaurice ,  Xing-Dong Yang ,  Pourang Polad Irani

IPC: G06F3/0488

Abstract: Systems and methods for providing graphical user interface elements optimized for touch-based input in connection with an application that is designed for conventional input received from a keyboard and a mouse. The touch-based graphical user interface elements are displayed when the computer system detects that a user is about to switch from conventional input devices to touch-sensitive input devices. The touch-based graphical user interface elements are hidden when the user provides input with the conventional input devices such that the touch-based graphical user interface elements do not distract from the applications normal operation. The display device includes a sensing capability that enables the computer system to detect when an object, such as a user's finger or a stylus, is proximate to, but not in contact with, the display device.

公开(公告)号：US20230195229A1

公开(公告)日：2023-06-22

申请号：US17555880

申请日：2021-12-20

Applicant: Da Yuan HUANG ,  Wei LI ,  Pourang Polad IRANI ,  Alice Jing Fei LIANG ,  Yukun ZHANG ,  Qing LIU

Inventor： Da Yuan HUANG ,  Wei LI ,  Pourang Polad IRANI ,  Alice Jing Fei LIANG ,  Yukun ZHANG ,  Qing LIU

IPC: G06F3/01 ,  G06F3/04883 ,  G06F3/041

CPC classification number: G06F3/016 ,  G06F3/04883 ,  G06F3/017 ,  G06F3/041 ,  G06F2203/04105

Abstract: Systems and methods for generating pseudo haptic feedback for a virtual widget are disclosed. The method includes computing, from a force profile of the virtual widget, a virtual displacement value based on a force value and a type of the virtual widget. The force profile describes a user's perception of physical characteristics of the virtual widget. The method generates a visual haptic feedback based on the virtual displacement value and the type of the virtual widget. Further, in response to the force value, the method may display on a display screen the visual haptic feedback.

公开(公告)号：US20230059153A1

公开(公告)日：2023-02-23

申请号：US17408201

申请日：2021-08-20

Applicant: Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Ghazaleh SANIEE-MONFARED ,  Sachi MIZOBUCHI ,  Xiu YI ,  Pourang Polad IRANI ,  Jian ZHAO ,  Wei LI

Inventor： Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Ghazaleh SANIEE-MONFARED ,  Sachi MIZOBUCHI ,  Xiu YI ,  Pourang Polad IRANI ,  Jian ZHAO ,  Wei LI

IPC: G06F3/01 ,  G06F3/03 ,  G06F3/0484

Abstract: Methods, devices, and media are disclosed for mapping of input and output spaces in head-based human-computer interactions. In some embodiments, an end-to-end method is described for designing a head-based user interface, calibrating the interface to individual users, and interacting with a user in real time by mapping head-based user inputs to an output space in a way that optimizes the target selection efficiency of the interaction. Head orientation may be leveraged to define the mapping between the user input and the output space.