公开(公告)号：US08701032B1

公开(公告)日：2014-04-15

申请号：US13787513

申请日：2013-03-06

Applicant: Google Inc.

Inventor： Shumin Zhai ,  Yu Ouyang ,  Ken Wakasa ,  Satoshi Kataoka

IPC: G06F15/00 ,  G06F13/00

CPC classification number: G06F17/277 ,  G06F3/017 ,  G06F3/0237 ,  G06F3/0414 ,  G06F3/04883 ,  G06F3/04886 ,  G06F17/276

Abstract: In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.

Abstract translation: 在一个示例中，计算设备包括至少一个处理器，其可操作地耦合到存在敏感显示器和由所述至少一个处理器可操作的手势模块。 手势模块可以由至少一个处理器操作以输出用于在存在敏感显示器处显示的包括多个键的图形键盘并且接收在存在敏感显示器处检测到的连续手势的指示，连续的 选择所述多个键中的一组键的手势。 手势模块还可操作以响应于接收到连续手势的指示并至少部分地基于多个键的键组来确定包括一组候选词的候选短语。

公开(公告)号：US10140284B2

公开(公告)日：2018-11-27

申请号：US15478775

申请日：2017-04-04

Applicant: Google, Inc.

Inventor： Xiaojun Bi ,  Yu Ouyang ,  Shumin Zhai

IPC: G06F3/00 ,  G06F17/27 ,  G06F3/0484 ,  G06F3/0488 ,  G06F3/023 ,  G06F3/01 ,  G06F3/041

Abstract: A graphical keyboard including a number of keys is output for display at a display device. The computing device receives an indication of a gesture to select at least two of the keys based at least in part on detecting an input unit at locations of a presence-sensitive input device. In response to the detecting and while the input unit is detected at the presence-sensitive input device: the computing device determines a candidate word for the gesture based at least in part on the at least two keys and the candidate word is output for display at a first location of the output device. In response to determining that the input unit is no longer detected at the presence-sensitive input device, the displayed candidate word is output for display at a second location of the display device.

公开(公告)号：US20180188948A1

公开(公告)日：2018-07-05

申请号：US15393676

申请日：2016-12-29

Applicant: Google Inc.

Inventor： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC: G06F3/0488 ,  G06F3/16 ,  G06F17/24 ,  G06F17/27

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US20170308522A1

公开(公告)日：2017-10-26

申请号：US15647887

申请日：2017-07-12

Applicant: Google Inc.

Inventor： Yu Ouyang ,  Shumin Zhai ,  Xiaojun Bi

IPC: G06F17/27 ,  G06F3/0484 ,  G06F3/01 ,  G06F3/023 ,  G06F3/0488

CPC classification number: G06F17/276 ,  G06F3/017 ,  G06F3/0237 ,  G06F3/04842 ,  G06F3/04883 ,  G06F3/04886

Abstract: A computing device outputs a keyboard for display, receives an indication of a first gesture to select a first sequence of one or more keys, determines a set of candidate strings based in part on the first sequence of keys, and outputs for display at least one of the set of candidate strings. The computing device receives an indication of a second gesture to select a second sequence of one or more keys, and determines that characters associated with the second sequence of keys are included in a first candidate word based at least in part on the set of candidate strings, or are included in a second candidate word not based on the first sequence of keys. The computing device modifies the set of candidate strings based at least in part on the determination and outputs for display at least one of the modified candidate strings.

公开(公告)号：US20170199665A1

公开(公告)日：2017-07-13

申请号：US15473010

申请日：2017-03-29

Applicant: Google Inc.

Inventor： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC: G06F3/0488 ,  G06N3/08 ,  G06F3/0482

CPC classification number: G06F3/04886 ,  G06F3/0219 ,  G06F3/0233 ,  G06F3/0237 ,  G06F3/0482 ,  G06F3/04883 ,  G06F3/04895 ,  G06F17/273 ,  G06F17/276 ,  G06F17/2765 ,  G06N3/0445 ,  G06N3/08

Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US09471220B2

公开(公告)日：2016-10-18

申请号：US14030742

申请日：2013-09-18

Applicant: Google Inc.

Inventor： Shumin Zhai ,  Yu Ouyang ,  Ying Yin

IPC: G06F3/041 ,  G06F3/048 ,  G06F3/0488 ,  G06F1/16 ,  G06F3/023

CPC classification number: G06F3/04886 ,  G06F1/1694 ,  G06F3/0237 ,  G06F3/0418 ,  G06F3/0488 ,  G06F3/04883

Abstract: In one example a computing device includes at least one processor, wherein the at least one processor may be configured to output for display, a graphical keyboard comprising a plurality of keys. The at least one processor may be configured to receive an indication of an input detected at a presence-sensitive input device operatively coupled to the computing device; and responsive to receiving the indication, determine an input posture of the input, wherein the input posture represents an orientation of the computing device in relation to an input unit used to provide the input. The at least one processor may be configured to select, based at least in part on the input posture, a spatial model that is used for determining a probability that at least one of the one or more of the plurality of keys has been selected.

Abstract translation: 在一个示例中，计算设备包括至少一个处理器，其中所述至少一个处理器可以被配置为输出用于显示，包括多个键的图形键盘。 所述至少一个处理器可以被配置为接收在可操作地耦合到所述计算设备的存在敏感输入设备处检测到的输入的指示; 并且响应于接收到所述指示，确定所述输入的输入姿势，其中所述输入姿势表示所述计算装置相对于用于提供所述输入的输入单元的取向。 至少一个处理器可以被配置为至少部分地基于输入姿势来选择用于确定已经选择了多个键中的一个或多个中的至少一个的概率的空间模型。

公开(公告)号：US09244612B1

公开(公告)日：2016-01-26

申请号：US13769094

申请日：2013-02-15

Applicant: Google Inc.

Inventor： Shiri Azenkot ,  Shumin Zhai ,  Ciprian Ioan Chelba ,  Yu Ouyang

IPC: G06F3/041 ,  G06F3/0489

CPC classification number: G06F3/0489 ,  G06F3/041 ,  G06F3/04883 ,  G06F3/04886

Abstract: In one example, a method includes outputting, by a computing device and for display, a graphical keyboard comprising a plurality of keys, and receiving, by the computing device, an indication of a gesture detected at a presence-sensitive input device. The method further includes determining, by the computing device, an input posture of the gesture at the presence-sensitive input device, and applying, by the computing device and based at least in part on the input posture, at least one offset to a location associated with a key from the plurality of keys to determine an offset location associated with the key, and in response to receiving the indication of the gesture, selecting, by the computing device and based at least in part on the offset location, the key as a selected key.

Abstract translation: 在一个示例中，方法包括由计算设备输出并显示包括多个键的图形键盘，以及由计算设备接收在存在敏感输入设备处检测到的手势的指示。 所述方法还包括由所述计算设备确定所述手势在所述存在敏感输入设备处的输入姿势，以及由所述计算设备至少部分地基于所述输入姿态来应用至少一个偏移到位置 与来自所述多个键的密钥相关联以确定与所述密钥相关联的偏移位置，并且响应于接收到所述手势的指示，由所述计算设备选择并且至少部分地基于所述偏移位置，将所述密钥作为 一个选定的键

公开(公告)号：US20150378983A1

公开(公告)日：2015-12-31

申请号：US14851759

申请日：2015-09-11

Applicant: Google Inc.

Inventor： Shumin Zhai ,  Yu Ouyang ,  Ken Wakasa ,  Satoshi Kataoka

IPC: G06F17/27 ,  G06F3/0488

CPC classification number: G06F17/277 ,  G06F3/017 ,  G06F3/0237 ,  G06F3/0414 ,  G06F3/04883 ,  G06F3/04886 ,  G06F17/276

Abstract: In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.

Abstract translation: 在一个示例中，计算设备包括至少一个处理器，其可操作地耦合到存在敏感显示器和由所述至少一个处理器可操作的手势模块。 手势模块可以由至少一个处理器操作以输出用于在存在敏感显示器处显示的包括多个键的图形键盘并且接收在存在敏感显示器处检测到的连续手势的指示，连续的 选择所述多个键中的一组键的手势。 手势模块还可操作以响应于接收到连续手势的指示并至少部分地基于多个键的键组来确定包括一组候选词的候选短语。

公开(公告)号：US20150149947A1

公开(公告)日：2015-05-28

申请号：US14548091

申请日：2014-11-19

Applicant: Google Inc.

Inventor： Xiaojun Bi ,  Kurt Edward Partridge ,  Yu Ouyang ,  Shumin Zhai

IPC: G06F3/0488

CPC classification number: G06F3/04886 ,  G06F3/0484 ,  G06F3/0488 ,  G06F3/04883

Abstract: Techniques are described for character deletion on a computing device that utilizes a gesture-based keyboard. The computing device includes a processor and at least one module operable by the processor to output, for display at a presence-sensitive display, a graphical keyboard comprising a plurality of keys and a text editor field. In response to receiving an indication of a gesture that comprises a first path, the module outputs a first character, based at least in part on the first path, associated with a first key and a second character associated with a second key. In response to determining that the gesture further comprises a second path that retraces at least a portion of the first path, the module removes the second character from the text editor field of the presence-sensitive display.

Abstract translation: 描述了在利用基于手势的键盘的计算设备上进行角色删除的技术。 计算设备包括处理器和至少一个可由处理器操作的模块，用于输出用于在存在敏感显示器处显示包括多个键和文本编辑器字段的图形键盘。 响应于接收到包括第一路径的手势的指示，模块至少部分地基于第一路径输出与第一密钥相关联的第一字符和与第二密钥相关联的第二字符。 响应于确定手势还包括回溯第一路径的至少一部分的第二路径，模块从存在敏感显示器的文本编辑器字段中移除第二字符。

公开(公告)号：US20150012873A1

公开(公告)日：2015-01-08

申请号：US14494798

申请日：2014-09-24

Applicant: Google Inc.

Inventor： Xiaojun Bi ,  Yu Ouyang ,  Shumin Zhai

IPC: G06F17/27 ,  G06F3/041 ,  G06F3/0488 ,  G06F3/01

CPC classification number: G06F17/276 ,  G06F3/017 ,  G06F3/0237 ,  G06F3/0412 ,  G06F3/0484 ,  G06F3/04883 ,  G06F3/04886

Abstract: A graphical keyboard including a number of keys is output for display at a display device. The computing device receives an indication of a gesture to select at least two of the keys based at least in part on detecting an input unit at locations of a presence-sensitive input device. In response to the detecting and while the input unit is detected at the presence-sensitive input device: the computing device determines a candidate word for the gesture based at least in part on the at least two keys and the candidate word is output for display at a first location of the output device. In response to determining that the input unit is no longer detected at the presence-sensitive input device, the displayed candidate word is output for display at a second location of the display device.

Abstract translation: 输出包括多个键的图形键盘，以在显示装置上显示。 所述计算设备至少部分地基于在存在敏感输入设备的位置处检测输入单元，接收手势的指示以选择至少两个所述键。 响应于检测并且当在存在敏感的输入设备处检测到输入单元时：计算设备至少部分地基于至少两个键确定用于手势的候选词，并且输出候选词以供显示在 输出设备的第一个位置。 响应于确定在存在敏感输入设备处不再检测到输入单元，输出所显示的候选词以在显示设备的第二位置显示。