公开(公告)号：US10601755B2

公开(公告)日：2020-03-24

申请号：US16170652

申请日：2018-10-25

Applicant: GOOGLE LLC

Inventor： Tilke Judd ,  Yariv Adan ,  Zaheed Sabur ,  Behshad Behzadi ,  Lucas Mirelmann ,  Jan Lamecki ,  Dhruv Bakshi

IPC: H04L12/58 ,  H04L29/08 ,  G06F9/48

Abstract: Methods, apparatus, systems, and computer-readable media are provided for: operating an instance of a personal assistant module to serve a user while the user operates the client computing device, wherein the instance of the personal assistant module has access to a persistent record of a message exchange thread between the user and instance(s) of the personal assistant module; detecting cue(s) emanating from the persistent message exchange thread; identifying candidate application(s) that are installed on a client computing device operated by the user, wherein the candidate application(s) are associated with content of the message exchange thread; and incorporating, into a transcript of the message exchange thread that is displayed in a graphical user interface rendered on the client computing device, selectable link (operable by the user to cause the client computing device to expose to the user an interface associated with a respective candidate application.

公开(公告)号：US20190082018A1

公开(公告)日：2019-03-14

申请号：US15953779

申请日：2018-04-16

Applicant: Google LLC

Inventor： Zaheed Sabur ,  Andrea Terwisscha van Scheltinga ,  Mikhail Reutov ,  Lucas Mirelmann

IPC: H04L29/08 ,  G06F3/16

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for pairing a speech-enabled device with a display device. A determination may be made to pair a speech-enabled device with a display device of a particular type. A set of display devices that are associated with the speech-enabled device may be identified in response to determining to pair the speech-enabled device with the display device of the particular type. An instruction may be provided to each of the display devices. The instruction may cause the display device to determine (i) whether the display device is of the particular type and (ii) whether the display device and the speech-enabled device both share a local area network and display on the display device an indication regarding pairing with the speech-enabled device.

公开(公告)号：US20240420699A1

公开(公告)日：2024-12-19

申请号：US18815252

申请日：2024-08-26

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Alvin Abdagic ,  Behshad Behzadi ,  Jacopo Sannazzaro Natta ,  Julia Proskurnia ,  Krzysztof Andrzej Goj ,  Srikanth Pandiri ,  Viesturs Zarins ,  Nicolo D'Ercole ,  Zaheed Sabur ,  Luv Kothari

IPC: G10L15/26 ,  G06F3/0488 ,  G06N20/00 ,  G10L15/18 ,  G10L15/22

Abstract: Systems and methods described herein relate to determining whether to incorporate recognized text, that corresponds to a spoken utterance of a user of a client device, into a transcription displayed at the client device, or to cause an assistant command, that is associated with the transcription and that is based on the recognized text, to be performed by an automated assistant implemented by the client device. The spoken utterance is received during a dictation session between the user and the automated assistant. Implementations can process, using automatic speech recognition model(s), audio data that captures the spoken utterance to generate the recognized text. Further, implementations can determine whether to incorporate the recognized text into the transcription or cause the assistant command to be performed based on touch input being directed to the transcription, a state of the transcription, and/or audio-based characteristic(s) of the spoken utterance.

公开(公告)号：US20240420697A1

公开(公告)日：2024-12-19

申请号：US18815514

申请日：2024-08-26

Applicant: GOOGLE LLC

Inventor： Denis Burakov ,  Sergey Nazarov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Zaheed Sabur ,  Okan Kolak ,  Yan Zhong ,  Vinh Quoc Ly

IPC: G10L15/22 ,  G06F3/16

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

公开(公告)号：US20240411513A1

公开(公告)日：2024-12-12

申请号：US18808933

申请日：2024-08-19

Applicant: GOOGLE LLC

Inventor： Srikanth Pandiri ,  Luv Kothari ,  Behshad Behzadi ,  Zaheed Sabur ,  Domenico Carbotta ,  Akshay Kannan ,  Qi Wang ,  Gokay Baris Gultekin ,  Angana Ghosh ,  Xu Liu ,  Yang Lu ,  Steve Cheng

IPC: G06F3/16 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/04886 ,  G06F40/117 ,  G06F40/143 ,  G06F40/174 ,  G06F40/30 ,  G10L15/22 ,  G10L15/26

Abstract: Implementations set forth herein relate to an automated assistant that can selectively determine whether to incorporate a verbatim interpretation of portions spoken utterances into an entry field and/or incorporate synonymous content into the entry field. For instance, a user can be accessing an interface that provides an entry field (e.g., address field) for receiving user input. In order to provide input for entry field, the user can select the entry field and/or access a GUI keyboard to initialize an automated assistant for assisting with filling the entry field. Should the user provide a spoken utterance, the user can elect to provide a spoken utterance that embodies the intended input (e.g., an actual address) or a reference to the intended input (e.g., a name). In response to the spoken utterance, the automated assistant can fill the entry field with the intended input without necessitating further input from the user.

公开(公告)号：US20240355327A1

公开(公告)日：2024-10-24

申请号：US18623853

申请日：2024-04-01

Applicant: GOOGLE LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/30 ,  H04L67/01 ,  H04L67/568

CPC classification number: G10L15/22 ,  G06F3/165 ,  G06F3/167 ,  G10L15/1815 ,  G10L15/30 ,  H04L67/568 ,  G10L2015/223 ,  H04L67/01

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

公开(公告)号：US20240321277A1

公开(公告)日：2024-09-26

申请号：US18677629

申请日：2024-05-29

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Krishna Sapkota ,  Behshad Behzadi ,  Julia Proskurnia ,  Jacopo Sannazzaro Natta ,  Justin Lu ,  Magali Boizot-Roche ,  Marius Sajgalik ,  Nicolo D'Ercole ,  Zaheed Sabur ,  Luv Kothari

IPC: G10L15/26 ,  G10L15/22

CPC classification number: G10L15/26 ,  G10L15/22 ,  G10L2015/223

Abstract: Implementations described herein relate to an application and/or automated assistant that can identify arrangement operations to perform for arranging text during speech-to-text operations—without a user having to expressly identify the arrangement operations. In some instances, a user that is dictating a document (e.g., an email, a text message, etc.) can provide a spoken utterance to an application in order to incorporate textual content. However, in some of these instances, certain corresponding arrangements are needed for the textual content in the document. The textual content that is derived from the spoken utterance can be arranged by the application based on an intent, vocalization features, and/or contextual features associated with the spoken utterance and/or a type of the application associated with the document, without the user expressly identifying the corresponding arrangements. In this way, the application can infer content arrangement operations from a spoken utterance that only specifies the textual content.

公开(公告)号：US12093609B2

公开(公告)日：2024-09-17

申请号：US18388465

申请日：2023-11-09

Applicant: GOOGLE LLC

Inventor： Srikanth Pandiri ,  Luv Kothari ,  Behshad Behzadi ,  Zaheed Sabur ,  Domenico Carbotta ,  Akshay Kannan ,  Qi Wang ,  Gokay Baris Gultekin ,  Angana Ghosh ,  Xu Liu ,  Yang Lu ,  Steve Cheng

IPC: G06F3/048 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/04886 ,  G06F3/16 ,  G06F40/117 ,  G06F40/143 ,  G06F40/174 ,  G06F40/30 ,  G10L15/22 ,  G10L15/26

CPC classification number: G06F3/167 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/04886 ,  G06F40/117 ,  G06F40/143 ,  G06F40/174 ,  G06F40/30 ,  G10L15/22 ,  G10L15/26

Abstract: Implementations set forth herein relate to an automated assistant that can selectively determine whether to incorporate a verbatim interpretation of portions spoken utterances into an entry field and/or incorporate synonymous content into the entry field. For instance, a user can be accessing an interface that provides an entry field (e.g., address field) for receiving user input. In order to provide input for entry field, the user can select the entry field and/or access a GUI keyboard to initialize an automated assistant for assisting with filling the entry field. Should the user provide a spoken utterance, the user can elect to provide a spoken utterance that embodies the intended input (e.g., an actual address) or a reference to the intended input (e.g., a name). In response to the spoken utterance, the automated assistant can fill the entry field with the intended input without necessitating further input from the user.

公开(公告)号：US12045248B2

公开(公告)日：2024-07-23

申请号：US17144898

申请日：2021-01-08

Applicant: Google LLC

Inventor： Tilke Mary Judd ,  Zaheed Sabur ,  Eduardo Jodas Samper ,  Alexandru Ovidiu Dovlecel ,  Ardan Arac

IPC: G06F16/00 ,  G06F16/2457 ,  G06F16/248 ,  G06F16/951

CPC classification number: G06F16/248 ,  G06F16/24578 ,  G06F16/951

Abstract: Implementations include actions of obtaining a set of entities based on one or more terms of a query, obtaining one or more entities associated with each live event of a plurality of live events, identifying a live event that is responsive to the query based on comparing at least one entity in the set of entities to one or more entities associated with each live event of a plurality of live events, determining that an event search result corresponding to the live event is to be displayed in search results, and in response: providing the event search result for display, the event search result including information associated with the live event, the information including an indicator of an occurrence of the live event.

公开(公告)号：US11887594B2

公开(公告)日：2024-01-30

申请号：US17572293

申请日：2022-01-10

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Zaheed Sabur ,  Vladimir Vuskovic ,  Adrian Zumbrunnen ,  Lucas Mirelmann

IPC: G10L15/22 ,  G06F16/903 ,  G10L15/18 ,  G06N3/006

CPC classification number: G10L15/22 ,  G06F16/90335 ,  G06N3/006 ,  G10L15/1815 ,  G10L15/1822 ,  G10L2015/223

Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.