公开(公告)号：US11875274B1

公开(公告)日：2024-01-16

申请号：US18100440

申请日：2023-01-23

申请人： GOOGLE LLC

发明人： Yu Ouyang

IPC分类号： G06N5/04 ,  G06F3/16

CPC分类号： G06N5/04 ,  G06F3/167

摘要： A method may include determining, by a computing device and based on at least one user coherency factor, a user coherency level. The coherency level may include a predicted ability of a user to comprehend information. The method may also include determining, by the computing device and based on the user coherency level, information having a complexity that satisfies the predicted ability of the user to comprehend information. The method may further include outputting, by the computing device, at least a portion of the information.

公开(公告)号：US20220413696A1

公开(公告)日：2022-12-29

申请号：US17823545

申请日：2022-08-31

申请人： Google LLC

发明人： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC分类号： G06F3/04886 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F3/04883 ,  G06F40/166 ,  G06F40/289

摘要： Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US20200050661A1

公开(公告)日：2020-02-13

申请号：US16655067

申请日：2019-10-16

申请人： Google LLC

发明人： Shumin Zhai ,  Yu Ouyang ,  Ken Wakasa ,  Satoshi Kataoka

IPC分类号： G06F17/27 ,  G06F3/01 ,  G06F3/023 ,  G06F3/0488

摘要： In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.

公开(公告)号：US11842045B2

公开(公告)日：2023-12-12

申请号：US17823545

申请日：2022-08-31

申请人： Google LLC

发明人： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC分类号： G06F3/04886 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F3/04883 ,  G06F40/166 ,  G06F40/289 ,  G10L15/22

CPC分类号： G06F3/04886 ,  G06F1/1626 ,  G06F3/0233 ,  G06F3/04883 ,  G06F3/167 ,  G06F40/166 ,  G06F40/289 ,  G06F2203/0381 ,  G10L15/22

摘要： Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US11573698B2

公开(公告)日：2023-02-07

申请号：US17469622

申请日：2021-09-08

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/02 ,  G06F3/04886 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/023 ,  G06F3/04895 ,  G06F3/0482 ,  G06F3/04883 ,  G06N3/08

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US10831366B2

公开(公告)日：2020-11-10

申请号：US15393676

申请日：2016-12-29

申请人： Google LLC

发明人： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC分类号： G06F3/0488 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F40/166 ,  G06F40/289 ,  G10L15/22

摘要： Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US10671281B2

公开(公告)日：2020-06-02

申请号：US16261640

申请日：2019-01-30

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/02 ,  G06F3/0488 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/0482 ,  G06N3/08

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US20180074698A1

公开(公告)日：2018-03-15

申请号：US15808233

申请日：2017-11-09

申请人： Google LLC

发明人： Yu Ouyang ,  Shumin Zhai

IPC分类号： G06F3/0488 ,  G06F17/27

CPC分类号： G06F3/04886 ,  G06F3/0236 ,  G06F3/0237 ,  G06F3/04883 ,  G06F3/04897 ,  G06F17/273 ,  G06F17/276 ,  Y10S707/99935 ,  Y10S707/99936

摘要： In one example, a method may include outputting, by a computing device and for display, a graphical keyboard comprising a plurality of keys, and receiving an indication of a gesture. The method may include determining an alignment score that is based at least in part on a word prefix and an alignment point traversed by the gesture. The method may include determining at least one alternative character that is based at least in part on a misspelling that includes at least a portion of the word prefix. The method may include determining an alternative alignment score based at least in part on the alternative character; and outputting, by the computing device and for display, based at least in part on the alternative alignment score, a candidate word based at least in part on the alternative character.

公开(公告)号：US11379663B2

公开(公告)日：2022-07-05

申请号：US17192105

申请日：2021-03-04

申请人： Google LLC

发明人： Yu Ouyang ,  Shumin Zhai ,  Xiaojun Bi

IPC分类号： G06F3/04886 ,  G06F40/274 ,  G06F3/023 ,  G06F3/04842 ,  G06F3/04883 ,  G06F3/01

摘要： A computing device outputs a keyboard for display, receives an indication of a first gesture to select a first sequence of one or more keys, determines a set of candidate strings based in part on the first sequence of keys, and outputs for display at least one of the set of candidate strings. The computing device receives an indication of a second gesture to select a second sequence of one or more keys, and determines that characters associated with the second sequence of keys are included in a first candidate word based at least in part on the set of candidate strings, or are included in a second candidate word not based on the first sequence of keys. The computing device modifies the set of candidate strings based at least in part on the determination and outputs for display at least one of the modified candidate strings.

公开(公告)号：US11150804B2

公开(公告)日：2021-10-19

申请号：US16862628

申请日：2020-04-30

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/02 ,  G06F3/0488 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/0482 ,  G06N3/08

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.