公开(公告)号：US20240185857A1

公开(公告)日：2024-06-06

申请号：US18439411

申请日：2024-02-12

Applicant: GOOGLE LLC

Inventor： Denis Burakov ,  Behshad Behzadi ,  Mario Bertschlewr ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Sergey Nazarov ,  Zaheed Sabur ,  Marcin Nowak-Przygodzki ,  Mugurel Ionut Andreica ,  Radu Voroneanu

IPC: G10L15/26 ,  G06F3/16 ,  G10L15/22

CPC classification number: G10L15/26 ,  G06F3/167 ,  G10L15/22 ,  G10L2015/223

Abstract: Implementations set forth herein relate to a system that employs an automated assistant to further interactions between a user and another application, which can provide the automated assistant with permission to initialize relevant application actions simultaneous to the user interacting with the other application. Furthermore, the system can allow the automated assistant to initialize actions of different applications, despite being actively operating a particular application. Available actions can be gleaned by the automated assistant using various application-specific schemas, which can be compared with incoming requests from a user to the automated assistant. Additional data, such as context and historical interactions, can also be used to rank and identify a suitable application action to be initialized via the automated assistant.

公开(公告)号：US20240078083A1

公开(公告)日：2024-03-07

申请号：US18388465

申请日：2023-11-09

Applicant: GOOGLE LLC

Inventor： Srikanth Pandiri ,  Luv Kolhari ,  Behshad Behzadi ,  Zaheed Sabur ,  Domenico Carbotta ,  Akshay Kannan ,  Qi Wang ,  Gokay Baris Gultekin ,  Angana Ghosh ,  Xu Liu ,  Yang Lu ,  Steve Cheng

IPC: G06F3/16 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/04886 ,  G06F40/117 ,  G06F40/143 ,  G06F40/174 ,  G06F40/30 ,  G10L15/22 ,  G10L15/26

CPC classification number: G06F3/167 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/04886 ,  G06F40/117 ,  G06F40/143 ,  G06F40/174 ,  G06F40/30 ,  G10L15/22 ,  G10L15/26

Abstract: Implementations set forth herein relate to an automated assistant that can selectively determine whether to incorporate a verbatim interpretation of portions spoken utterances into an entry field and/or incorporate synonymous content into the entry field. For instance, a user can be accessing an interface that provides an entry field (e.g., address field) for receiving user input. In order to provide input for entry field, the user can select the entry field and/or access a GUI keyboard to initialize an automated assistant for assisting with filling the entry field. Should the user provide a spoken utterance, the user can elect to provide a spoken utterance that embodies the intended input (e.g., an actual address) or a reference to the intended input (e.g., a name). In response to the spoken utterance, the automated assistant can fill the entry field with the intended input without necessitating further input from the user.

公开(公告)号：US11830491B2

公开(公告)日：2023-11-28

申请号：US17552887

申请日：2021-12-16

Applicant: Google LLC

Inventor： Andrea Terwisscha van Scheltinga ,  Nicolo D'Ercole ,  Zaheed Sabur ,  Bibo Xu ,  Megan Knight ,  Alvin Abdagic ,  Jan Lamecki ,  Bo Zhang

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/08

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L15/083 ,  G10L2015/223

Abstract: Determining whether, upon cessation of a second automated assistant session that interrupted and supplanted a prior first automated assistant session: (1) to automatically resume the prior first automated assistant session, or (2) to transition to an alternative automated assistant state in which the prior first session is not automatically resumed. Implementations further relate to selectively causing, based on the determining and upon cessation of the second automated assistant session, either the automatic resumption of the prior first automated assistant session that was interrupted, or the transition to the state in which the first session is not automatically resumed.

公开(公告)号：US11765113B2

公开(公告)日：2023-09-19

申请号：US17991300

申请日：2022-11-21

Applicant: Google LLC

Inventor： Fredrik Bergenlid ,  Vladyslav Lysychkin ,  Denis Burakov ,  Behshad Behzadi ,  Andrea Terwisscha Van Scheltinga ,  Quentin Lascombes De Laroussilhe ,  Mikhail Golikov ,  Koa Metter ,  Ibrahim Badr ,  Zaheed Sabur

IPC: H04L51/10 ,  H04N7/15 ,  G06F16/44 ,  H04N21/4788 ,  H04N21/439 ,  G10L15/22 ,  G10L25/63 ,  G10L15/16 ,  G10L15/00

CPC classification number: H04L51/10 ,  G06F16/44 ,  G10L15/22 ,  H04N7/15 ,  H04N21/4394 ,  H04N21/4788 ,  G10L15/005 ,  G10L15/16 ,  G10L25/63 ,  G10L2015/223

Abstract: Implementations relate to providing information items for display during a communication session. In some implementations, a computer-implemented method includes receiving, during a communication session between a first computing device and a second computing device, first media content from the communication session. The method further includes determining a first information item for display in the communication session based at least in part on the first media content. The method further includes sending a first command to at least one of the first computing device and the second computing device to display the first information item.

公开(公告)号：US11741961B2

公开(公告)日：2023-08-29

申请号：US17552887

申请日：2021-12-16

Applicant: Google LLC

Inventor： Andrea Terwisscha van Scheltinga ,  Nicolo D'Ercole ,  Zaheed Sabur ,  Bibo Xu ,  Megan Knight ,  Alvin Abdagic ,  Jan Lamecki ,  Bo Zhang

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/08

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L15/083 ,  G10L2015/223

Abstract: Determining whether, upon cessation of a second automated assistant session that interrupted and supplanted a prior first automated assistant session: (1) to automatically resume the prior first automated assistant session, or (2) to transition to an alternative automated assistant state in which the prior first session is not automatically resumed. Implementations further relate to selectively causing, based on the determining and upon cessation of the second automated assistant session, either the automatic resumption of the prior first automated assistant session that was interrupted, or the transition to the state in which the first session is not automatically resumed.

公开(公告)号：US11553051B2

公开(公告)日：2023-01-10

申请号：US17379073

申请日：2021-07-19

Applicant: Google LLC

Inventor： Zaheed Sabur ,  Andrea Terwisscha van Scheltinga ,  Mikhail Reutov ,  Lucas Mirelmann

IPC: H04L67/51 ,  H04W8/00 ,  G06F3/16

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for pairing a speech-enabled device with a display device. A determination may be made to pair a speech-enabled device with a display device of a particular type. A set of display devices that are associated with the speech-enabled device may be identified in response to determining to pair the speech-enabled device with the display device of the particular type. An instruction may be provided to each of the display devices. The instruction may cause the display device to determine (i) whether the display device is of the particular type and (ii) whether the display device and the speech-enabled device both share a local area network and display on the display device an indication regarding pairing with the speech-enabled device.

公开(公告)号：US11509616B2

公开(公告)日：2022-11-22

申请号：US17031416

申请日：2020-09-24

Applicant: Google LLC

Inventor： Fredrik Bergenlid ,  Vladyslav Lysychkin ,  Denis Burakov ,  Behshad Behzadi ,  Andrea Terwisscha Van Scheltinga ,  Quentin Lascombes De Laroussilhe ,  Mikhail Golikov ,  Koa Metter ,  Ibrahim Badr ,  Zaheed Sabur

IPC: H04L51/10 ,  H04N7/15 ,  G06F16/44 ,  H04N21/4788 ,  H04N21/439 ,  G10L15/22 ,  G10L25/63 ,  G10L15/16 ,  G10L15/00

Abstract: Implementations relate to providing information items for display during a communication session. In some implementations, a computer-implemented method includes receiving, during a communication session between a first computing device and a second computing device, first media content from the communication session. The method further includes determining a first information item for display in the communication session based at least in part on the first media content. The method further includes sending a first command to at least one of the first computing device and the second computing device to display the first information item.

公开(公告)号：US20220157317A1

公开(公告)日：2022-05-19

申请号：US17588481

申请日：2022-01-31

Applicant: Google LLC

Inventor： Denis Burakov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Sergey NAZAROV ,  Zaheed Sabur ,  Marcin Nowak-Przygodzki ,  Mugurel Ionut Andreica ,  Radu Voroneanu

IPC: G10L15/26 ,  G06F3/16 ,  G10L15/22

Abstract: Implementations set forth herein relate to a system that employs an automated assistant to further interactions between a user and another application, which can provide the automated assistant with permission to initialize relevant application actions simultaneous to the user interacting with the other application. Furthermore, the system can allow the automated assistant to initialize actions of different applications, despite being actively operating a particular application. Available actions can be gleaned by the automated assistant using various application-specific schemas, which can be compared with incoming requests from a user to the automated assistant. Additional data, such as context and historical interactions, can also be used to rank and identify a suitable application action to be initialized via the automated assistant.

公开(公告)号：US20220130386A1

公开(公告)日：2022-04-28

申请号：US17572293

申请日：2022-01-10

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Zaheed Sabur ,  Vladimir Vuskovic ,  Adrian Zumbrunnen ,  Lucas Mirelmann

IPC: G10L15/22 ,  G06F16/903 ,  G10L15/18 ,  G06N3/00

Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.

公开(公告)号：US20220060804A1

公开(公告)日：2022-02-24

申请号：US17515837

申请日：2021-11-01

Applicant: Google LLC

Inventor： Andrea Terwisscha van Scheltinga ,  Zaheed Sabur ,  Michael Reutov ,  Pratik Gilda

IPC: H04Q3/00 ,  H04W36/00 ,  H04W76/15 ,  G06F3/16 ,  G10L15/22 ,  H04W8/20

Abstract: A first computing device may receive an indication of user input that is at least a part of a conversation between a user and a first assistant executing at the first computing device. The first assistant and/or an assistant executing at a digital assistant system may determine whether to handoff the conversation from the first assistant executing at the first computing device to a second assistant executing at a second computing device. In response to determining to handoff the conversation to the second assistant executing at the second computing device, the first assistant and/or the assistant executing at the digital assistant system may send to the second computing device a request to handoff the conversation which includes at least an indication of the conversation.