公开(公告)号：US12243533B2

公开(公告)日：2025-03-04

申请号：US18623853

申请日：2024-04-01

Applicant: GOOGLE LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G06F3/16 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  H04L67/01 ,  H04L67/568 ,  H04N23/60

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

公开(公告)号：US12073835B2

公开(公告)日：2024-08-27

申请号：US18241745

申请日：2023-09-01

Applicant: GOOGLE LLC

Inventor： Denis Burakov ,  Sergey Nazarov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Zaheed Sabur ,  Okan Kolak ,  Yan Zhong ,  Vinh Quoc Ly

IPC: G10L15/22 ,  G06F3/16

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L2015/223 ,  G10L2015/227

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

公开(公告)号：US11996102B2

公开(公告)日：2024-05-28

申请号：US18202236

申请日：2023-05-25

Applicant: GOOGLE LLC

Inventor： Lucas Mirelmann ,  Zaheed Sabur ,  Bohdan Vlasyuk ,  Marie Patriarche Bledowski ,  Sergey Nazarov ,  Denis Burakov ,  Behshad Behzadi ,  Michael Golikov ,  Steve Cheng ,  Daniel Cotting ,  Mario Bertschler

IPC: G10L15/22 ,  G10L15/08

CPC classification number: G10L15/22 ,  G10L15/083

Abstract: Implementations relate to receiving natural language input that requests an automated assistant to provide information and processing the natural language input to identify the requested information and to identify one or more predicted actions. Those implementations further cause a computing device, at which the natural language input is received, to render the requested information and the one or more predicted actions in response to the natural language input. Yet further, those implementations, in response to the user confirming a rendered predicted action, cause the automated assistant to initialize the predicted action.

公开(公告)号：US11853649B2

公开(公告)日：2023-12-26

申请号：US17619414

申请日：2019-12-13

Applicant: GOOGLE LLC

Inventor： Srikanth Pandiri ,  Luv Kothari ,  Behshad Behzadi ,  Zaheed Sabur ,  Domenico Carbotta ,  Akshay Kannan ,  Qi Wang ,  Gokay Baris Gultekin ,  Angana Ghosh ,  Xu Liu ,  Yang Lu ,  Steve Cheng

IPC: G06F40/117 ,  G06F3/16 ,  G06F40/143 ,  G06F40/30 ,  G06F40/174 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/04886 ,  G10L15/22 ,  G10L15/26

CPC classification number: G06F3/167 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/04886 ,  G06F40/117 ,  G06F40/143 ,  G06F40/174 ,  G06F40/30 ,  G10L15/22 ,  G10L15/26

Abstract: Implementations set forth herein relate to an automated assistant that can selectively determine whether to incorporate a verbatim interpretation of portions spoken utterances into an entry field and/or incorporate synonymous content into the entry field. For instance, a user can be accessing an interface that provides an entry field (e.g., address field) for receiving user input. In order to provide input for entry field, the user can select the entry field and/or access a GUI keyboard to initialize an automated assistant for assisting with filling the entry field. Should the user provide a spoken utterance, the user can elect to provide a spoken utterance that embodies the intended input (e.g., an actual address) or a reference to the intended input (e.g., a name). In response to the spoken utterance, the automated assistant can fill the entry field with the intended input without necessitating further input from the user.

公开(公告)号：US20230239596A1

公开(公告)日：2023-07-27

申请号：US18127465

申请日：2023-03-28

Applicant: GOOGLE LLC

Inventor： Andrea Terwisscha van Scheltinga ,  Zaheed Sabur ,  Michael Reutov ,  Pratik Gilda

IPC: H04Q3/00 ,  H04W36/00 ,  H04W76/15 ,  G06F3/16 ,  G10L15/22 ,  H04W8/20

CPC classification number: H04Q3/0033 ,  H04W36/0094 ,  H04W76/15 ,  G06F3/167 ,  G10L15/22 ,  H04W8/205 ,  H04Q2213/13547 ,  H04W36/24

Abstract: A first computing device may receive an indication of user input that is at least a part of a conversation between a user and a first assistant executing at the first computing device. The first assistant and/or an assistant executing at a digital assistant system may determine whether to handoff the conversation from the first assistant executing at the first computing device to a second assistant executing at a second computing device. In response to determining to handoff the conversation to the second assistant executing at the second computing device, the first assistant and/or the assistant executing at the digital assistant system may send to the second computing device a request to handoff the conversation which includes at least an indication of the conversation.

公开(公告)号：US11631412B2

公开(公告)日：2023-04-18

申请号：US17521131

申请日：2021-11-08

Applicant: Google LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/30 ,  H04L29/08 ,  H04L29/06 ,  H04L67/568 ,  H04L67/01

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

公开(公告)号：US20230061929A1

公开(公告)日：2023-03-02

申请号：US17532315

申请日：2021-11-22

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Antonio Gaetani ,  Bastiaan Van Eeckhoudt ,  Daniel Valcarce ,  Michael Golikov ,  Justin Lu ,  Ondrej Skopek ,  Nicolo D'Ercole ,  Zaheed Sabur ,  Behshad Behzadi ,  Luv Kothari

IPC: G10L17/22

Abstract: Implementations described herein relate to configuring a dynamic warm word button, that is associated with a client device, with particular assistant commands based on detected occurrences of warm word activation events at the client device. In response to detecting an occurrence of a given warm word activation event at the client device, implementations can determine whether user verification is required for a user that actuated the warm word button. Further, in response to determining that the user verification is required for the user that actuated the warm word button, the user verification can be performed. Moreover, in response to determining that the user that actuated the warm word button has been verified, implementations can cause an automated assistant to perform the particular assistant command associated with the warm word activation event. Audio-based and/or non-audio-based techniques can be utilized to perform the user verification.

公开(公告)号：US20220366910A1

公开(公告)日：2022-11-17

申请号：US17322765

申请日：2021-05-17

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Alvin Abdagic ,  Behshad Behzadi ,  Jacopo Sannazzaro Natta ,  Julia Proskurnia ,  Krzysztof Andrzej Goj ,  Srikanth Pandiri ,  Viesturs Zarins ,  Nicolo D'Ercole ,  Zaheed Sabur ,  Luv Kothari

IPC: G10L15/26 ,  G10L15/22 ,  G10L15/18 ,  G06F3/0488 ,  G06N20/00

Abstract: Systems and methods described herein relate to determining whether to incorporate recognized text, that corresponds to a spoken utterance of a user of a client device, into a transcription displayed at the client device, or to cause an assistant command, that is associated with the transcription and that is based on the recognized text, to be performed by an automated assistant implemented by the client device. The spoken utterance is received during a dictation session between the user and the automated assistant. Implementations can process, using automatic speech recognition model(s), audio data that captures the spoken utterance to generate the recognized text. Further, implementations can determine whether to incorporate the recognized text into the transcription or cause the assistant command to be performed based on touch input being directed to the transcription, a state of the transcription, and/or audio-based characteristic(s) of the spoken utterance.

公开(公告)号：US20220130385A1

公开(公告)日：2022-04-28

申请号：US17569811

申请日：2022-01-06

Applicant: GOOGLE LLC

Inventor： Lucas Mirelmann ,  Zaheed Sabur ,  Bohdan Vlasyuk ,  Marie Patriarche Bledowski ,  Sergey NAZAROV ,  Denis Burakov ,  Behshad Behzadi ,  Michael Golikov ,  Steve CHENG ,  Daniel Cotting ,  Mario Bertschler

IPC: G10L15/22 ,  G10L15/08

Abstract: Implementations herein relate to pre-caching data, corresponding to predicted interactions between a user and an automated assistant, using data characterizing previous interactions between the user and the automated assistant. An interaction can be predicted based on details of a current interaction between the user and an automated assistant. One or more predicted interactions can be initialized, and/or any corresponding data pre-cached, prior to the user commanding the automated assistant in furtherance of the predicted interaction. Interaction predictions can be generated using a user-parameterized machine learning model, which can be used when processing input(s) that characterize a recent user interaction with the automated assistant. Should the user command the automated assistant in a way that is aligned with a pre-cached, predicted interaction, the automated assistant will exhibit instant fulfillment of the command, thereby eliminating any latency that the user would have otherwise experienced interacting with the automated assistant.

公开(公告)号：US11166087B2

公开(公告)日：2021-11-02

申请号：US16712021

申请日：2019-12-12

Applicant: Google LLC

Inventor： Andrea Terwisscha van Scheltinga ,  Zaheed Sabur ,  Michael Reutov ,  Pratik Gilda

IPC: H04Q3/00 ,  H04W36/00 ,  H04W76/15 ,  G06F3/16 ,  G10L15/22 ,  H04W8/20 ,  H04L29/08 ,  H04W36/24

Abstract: A first computing device may receive an indication of user input that is at least a part of a conversation between a user and a first assistant executing at the first computing device. The first assistant and/or an assistant executing at a digital assistant system may determine whether to handoff the conversation from the first assistant executing at the first computing device to a second assistant executing at a second computing device. In response to determining to handoff the conversation to the second assistant executing at the second computing device, the first assistant and/or the assistant executing at the digital assistant system may send to the second computing device a request to handoff the conversation which includes at least an indication of the conversation.