公开(公告)号：US20210192135A1

公开(公告)日：2021-06-24

申请号：US17192105

申请日：2021-03-04

申请人： Google LLC

发明人： Yu Ouyang ,  Shumin Zhai ,  Xiaojun Bi

IPC分类号： G06F40/274 ,  G06F3/023 ,  G06F3/0484 ,  G06F3/0488 ,  G06F3/01

摘要： A computing device outputs a keyboard for display, receives an indication of a first gesture to select a first sequence of one or more keys, determines a set of candidate strings based in part on the first sequence of keys, and outputs for display at least one of the set of candidate strings. The computing device receives an indication of a second gesture to select a second sequence of one or more keys, and determines that characters associated with the second sequence of keys are included in a first candidate word based at least in part on the set of candidate strings, or are included in a second candidate word not based on the first sequence of keys. The computing device modifies the set of candidate strings based at least in part on the determination and outputs for display at least one of the modified candidate strings.

公开(公告)号：US20240086063A1

公开(公告)日：2024-03-14

申请号：US18517825

申请日：2023-11-22

申请人： Google LLC

发明人： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC分类号： G06F3/04886 ,  G06F1/16 ,  G06F3/023 ,  G06F3/04883 ,  G06F3/16 ,  G06F40/166 ,  G06F40/289

CPC分类号： G06F3/04886 ,  G06F1/1626 ,  G06F3/0233 ,  G06F3/04883 ,  G06F3/167 ,  G06F40/166 ,  G06F40/289 ,  G06F2203/0381 ,  G10L15/22

摘要： Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US11435898B2

公开(公告)日：2022-09-06

申请号：US17064173

申请日：2020-10-06

申请人： Google LLC

发明人： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC分类号： G06F3/04886 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F3/04883 ,  G06F40/166 ,  G06F40/289 ,  G10L15/22

摘要： Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US20210405868A1

公开(公告)日：2021-12-30

申请号：US17469622

申请日：2021-09-08

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/0488 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/02 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/0482 ,  G06N3/08

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US20210019046A1

公开(公告)日：2021-01-21

申请号：US17064173

申请日：2020-10-06

申请人： Google LLC

发明人： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC分类号： G06F3/0488 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F40/166 ,  G06F40/289

摘要： Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US10241673B2

公开(公告)日：2019-03-26

申请号：US15808233

申请日：2017-11-09

申请人： Google LLC

发明人： Yu Ouyang ,  Shumin Zhai

IPC分类号： G06F3/041 ,  G06F3/0488 ,  G06F17/27 ,  G06F3/0489 ,  G06F3/023

摘要： In one example, a method may include outputting, by a computing device and for display, a graphical keyboard comprising a plurality of keys, and receiving an indication of a gesture. The method may include determining an alignment score that is based at least in part on a word prefix and an alignment point traversed by the gesture. The method may include determining at least one alternative character that is based at least in part on a misspelling that includes at least a portion of the word prefix. The method may include determining an alternative alignment score based at least in part on the alternative character; and outputting, by the computing device and for display, based at least in part on the alternative alignment score, a candidate word based at least in part on the alternative character.

公开(公告)号：US11562261B1

公开(公告)日：2023-01-24

申请号：US16375266

申请日：2019-04-04

申请人： Google LLC

发明人： Yu Ouyang

IPC分类号： G06N5/04 ,  G06F3/16

摘要： A method may include determining, by a computing device and based on at least one user coherency factor, a user coherency level. The coherency level may include a predicted ability of a user to comprehend information. The method may also include determining, by the computing device and based on the user coherency level, information having a complexity that satisfies the predicted ability of the user to comprehend information. The method may further include outputting, by the computing device, at least a portion of the information.

公开(公告)号：US20200257447A1

公开(公告)日：2020-08-13

申请号：US16862628

申请日：2020-04-30

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/0488 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/02 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/0482 ,  G06N3/08

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US20190155504A1

公开(公告)日：2019-05-23

申请号：US16261640

申请日：2019-01-30

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/0488 ,  G06N3/04 ,  G06F17/27 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/02 ,  G06N3/08 ,  G06F3/0482

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.