公开(公告)号：US11740879B2

公开(公告)日：2023-08-29

申请号：US18046428

申请日：2022-10-13

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Xin Zhou ,  Gang Li ,  John Francis Canny

IPC: G06F17/00 ,  G06F8/38 ,  G06F40/40 ,  G06F8/33 ,  G06N3/0455 ,  G06F3/0484

CPC classification number: G06F8/38 ,  G06F3/0484 ,  G06F8/33 ,  G06F40/40 ,  G06N3/0455

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US20230031702A1

公开(公告)日：2023-02-02

申请号：US17812208

申请日：2022-07-13

Applicant: Google LLC

Inventor： Yang Li ,  Xin Zhou ,  Gang Li ,  Mostafa Dehghani ,  Alexey Alexeevich Gritsenko

IPC: G06V10/82 ,  G06F3/16 ,  G06F40/284

Abstract: A method includes receiving, via a computing device, a screenshot of a display provided by a graphical user interface of the computing device. The method also includes generating, by an image-structure transformer of a neural network, a representation by fusing a first embedding based on the screenshot and a second embedding based on a layout of virtual objects in the screenshot. The method additionally includes predicting, by the neural network and based on the generated representation, a modeling task output associated with the graphical user interface. The method further includes providing, by the computing device, the predicted modeling task output.

公开(公告)号：US12242824B2

公开(公告)日：2025-03-04

申请号：US18046446

申请日：2022-10-13

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Gang Li ,  Xin Zhou ,  John Francis Canny

IPC: G06F17/00 ,  G06F3/0484 ,  G06F8/33 ,  G06F8/38 ,  G06F40/40 ,  G06N3/0455

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US20230115185A1

公开(公告)日：2023-04-13

申请号：US18046446

申请日：2022-10-13

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Gang Li ,  Xin Zhou ,  John Francis Canny

IPC: G06F3/0484 ,  G06N3/0455 ,  G06F40/40

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US20230055094A1

公开(公告)日：2023-02-23

申请号：US17978790

申请日：2022-11-01

Applicant: Google LLC

Inventor： Christopher Co ,  Gang Li ,  Philip Chung ,  Justin Paul ,  Daniel Shing Shun Tse ,  Katherine Chou ,  Diana Jaunzeikare ,  Alvin Rajkomar

IPC: G16H15/00 ,  G16H10/60 ,  G16H70/20 ,  G06N20/00 ,  H04M11/10

Abstract: A method and system is provided for assisting a user to assign a label to words or spans of text in a transcript of a conversation between a patient and a medical professional and form groupings of such labelled words or spans of text in the transcript. The transcript is displayed on an interface of a workstation. A tool is provided for highlighting spans of text in the transcript consisting of one or more words. Another tool is provided for assigning a label to the highlighted spans of text. This tool includes a feature enabling searching through a set of predefined labels available for assignment to the highlighted span of text. The predefined labels encode medical entities and attributes of the medical entities. The interface further includes a tool for creating groupings of related highlighted spans of texts. The tools can consist of mouse action or keystrokes or a combination thereof.

公开(公告)号：US11521722B2

公开(公告)日：2022-12-06

申请号：US16612879

申请日：2017-10-20

Applicant: Google LLC

Inventor： Christopher Co ,  Gang Li ,  Philip Chung ,  Justin Paul ,  Daniel Shing Shun Tse ,  Katherine Chou ,  Diana Jaunzeikare ,  Alvin Rajkomar

IPC: G16H15/00 ,  G16H10/60 ,  G16H70/20 ,  G06N20/00 ,  H04M11/10

Abstract: A method and system is provided for assisting a user to assign a label to words or spans of text in a transcript of a conversation between a patient and a medical professional and form groupings of such labelled words or spans of text in the transcript. The transcript is displayed on an interface of a workstation. A tool is provided for highlighting spans of text in the transcript consisting of one or more words. Another tool is provided for assigning a label to the highlighted spans of text. This tool includes a feature enabling searching through a set of predefined labels available for assignment to the highlighted span of text. The predefined labels encode medical entities and attributes of the medical entities. The interface further includes a tool for creating groupings of related highlighted spans of texts. The tools can consist of mouse action or key strokes or a combination thereof.

公开(公告)号：US20230350651A1

公开(公告)日：2023-11-02

申请号：US18348191

申请日：2023-07-06

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Xin Zhou ,  Gang Li ,  John Francis Canny

IPC: G06F8/38 ,  G06F40/40 ,  G06F8/33 ,  G06N3/0455 ,  G06F3/0484

CPC classification number: G06F8/38 ,  G06F40/40 ,  G06F8/33 ,  G06N3/0455 ,  G06F3/0484

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US20230112710A1

公开(公告)日：2023-04-13

申请号：US18046428

申请日：2022-10-13

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Xin Zhou ,  Gang Li ,  John Francis Canny

IPC: G06F8/38 ,  G06F8/33 ,  G06F40/40

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US20200152302A1

公开(公告)日：2020-05-14

申请号：US16612879

申请日：2017-10-20

Applicant: Google LLC

Inventor： Christopher Co ,  Gang Li ,  Philip Chung ,  Justin Paul ,  Daniel Shing Shun Tse ,  Katherine Chou ,  Diana Jaunzeikare ,  Alvin Rajkomar

IPC: G16H15/00 ,  G16H10/60 ,  G16H70/20 ,  H04M11/10 ,  G06N20/00

Abstract: A method and system is provided for assisting a user to assign a label to words or spans of text in a transcript of a conversation between a patient and a medical professional and form groupings of such labelled words or spans of text in the transcript. The transcript is displayed on an interface of a workstation. A tool is provided for highlighting spans of text in the transcript consisting of one or more words. Another tool is provided for assigning a label to the highlighted spans of text. This tool includes a feature enabling searching through a set of predefined labels available for assignment to the highlighted span of text. The predefined labels encode medical entities and attributes of the medical entities. The interface further includes a tool for creating groupings of related highlighted spans of texts. The tools can consist of mouse action or key strokes or a combination thereof.