公开(公告)号：US11563848B2

公开(公告)日：2023-01-24

申请号：US17580324

申请日：2022-01-20

Applicant: Google LLC

Inventor： Yuval Baror ,  Michael Andrew Goodman ,  Praveen Krishnakumar

IPC: H04M3/436 ,  H04M3/42 ,  G10L15/22 ,  H04M3/51 ,  H04M3/428 ,  H04M3/493

Abstract: Implementations are directed to using an assistant to initiate automated telephone calls with entities. Some implementations identify an item of interest, identify a group of entities associated with the item, and initiate the calls with the entities. During a given call with a given entity, the assistant can request a status update regarding the item, and determine a temporal delay before initiating another call with the given entity to request a further status update regarding the item based on information received responsive to the request. Other implementations receive a request to perform an action on behalf of a user, identify a group of entities that can perform the action, and initiate a given call with a given entity. During the given call, the assistant can initiate an additional call with an additional entity, and generate notification(s), for the user, based on result(s) of the given call and/or the additional call.

公开(公告)号：US20220109753A1

公开(公告)日：2022-04-07

申请号：US17068511

申请日：2020-10-12

Applicant: Google LLC

Inventor： Yuval Baror ,  Michael Andrew Goodman ,  Yoav Tzur

IPC: H04M3/493 ,  H04M3/51 ,  G06F16/901

Abstract: Implementations are directed to utilizing an assistant to automatically navigate an interactive voice response (IVR) tree to arrive at a target state during an assisted telephone call. The assistant can receive input to initiate the assisted telephone call, identify an entity to engage with, on behalf of the user, and during the assisted telephone call, based on the input, and identify an IVR tree stored in association with the entity. In various implementations, navigation of the IVR tree can be modified based on interaction(s) detected at a client device subsequent to initiating the assisted telephone call. In various implementations, the assisted telephone call can be initiated from a search interface, and the target state can be associated with a given search result. In various implementations, the IVR tree can be dynamic in that only a subset of candidate state(s) of the IVR tree may be available as the target state.

公开(公告)号：US11240378B2

公开(公告)日：2022-02-01

申请号：US17332270

申请日：2021-05-27

Applicant: Google LLC

Inventor： Yuval Baror ,  Michael Andrew Goodman ,  Praveen Krishnakumar

IPC: H04M3/42 ,  H04M3/51 ,  G10L15/22 ,  H04M3/493 ,  H04M3/428

Abstract: Implementations are directed to using an assistant to initiate automated telephone calls with entities. Some implementations identify an item of interest, identify a group of entities associated with the item, and initiate the calls with the entities. During a given call with a given entity, the assistant can request a status update regarding the item, and determine a temporal delay before initiating another call with the given entity to request a further status update regarding the item based on information received responsive to the request. Other implementations receive a request to perform an action on behalf of a user, identify a group of entities that can perform the action, and initiate a given call with a given entity. During the given call, the assistant can initiate an additional call with an additional entity, and generate notification(s), for the user, based on result(s) of the given call and/or the additional call.

公开(公告)号：US20200175983A1

公开(公告)日：2020-06-04

申请号：US16617975

申请日：2019-05-04

Applicant: GOOGLE LLC

Inventor： Michael Andrew Goodman

IPC: G10L15/22 ,  G10L15/07 ,  G10L15/26

Abstract: Recommending an automated assistant action for inclusion in an existing automated assistant routine of a user, where the existing automated assistant routine includes a plurality of preexisting automated assistant actions. If the user confirms the recommendation through affirmative user interface input, the automated assistant action can be automatically added to the existing automated assistant routine. Thereafter, when the automated assistant routine is initialized, the preexisting automated assistant actions of the routine will be performed, as well as the automated assistant action that was automatically added to the routine in response to affirmative user interface input received in response to the recommendation.

公开(公告)号：US20190391998A1

公开(公告)日：2019-12-26

申请号：US16558907

申请日：2019-09-03

Applicant: GOOGLE LLC

Inventor： Michael Andrew Goodman ,  Bibo Xu

IPC: G06F16/635 ,  G06F3/16 ,  G10L15/22 ,  G06F16/332 ,  G06F16/242 ,  G06F16/00 ,  G06F1/16 ,  G06F1/18 ,  G06F3/0354 ,  G06F3/0362 ,  G06F3/0488 ,  H04L29/06

Abstract: A method of providing a personalized audio briefing to a user is performed at an electronic device. The device receives identification of information sources associated with the user. Each of the information sources is associated with a content type. The device receives an authorization to access the identified information sources and a preferred order of content types for presentation within the audio briefing. It transmits to a remote system the identification, the authorization, and the preferred order. Following the transmitting, the device receives a verbal input from the user requesting the audio briefing. In response to the verbal input, the device receives a response generated by the remote system, including content from the information sources and information inserted by the remote system based on the authorization to access received from the user. The device outputs an audible response according to the preferred order.

公开(公告)号：US12057120B2

公开(公告)日：2024-08-06

申请号：US18218333

申请日：2023-07-05

Applicant: GOOGLE LLC

Inventor： Michael Andrew Goodman

IPC: G10L15/22 ,  G10L15/07 ,  G10L15/26

CPC classification number: G10L15/22 ,  G10L15/07 ,  G10L15/26 ,  G10L2015/223 ,  G10L2015/225

Abstract: Recommending an automated assistant action for inclusion in an existing automated assistant routine of a user, where the existing automated assistant routine includes a plurality of preexisting automated assistant actions. If the user confirms the recommendation through affirmative user interface input, the automated assistant action can be automatically added to the existing automated assistant routine. Thereafter, when the automated assistant routine is initialized, the preexisting automated assistant actions of the routine will be performed, as well as the automated assistant action that was automatically added to the routine in response to affirmative user interface input received in response to the recommendation.

公开(公告)号：US20240064234A1

公开(公告)日：2024-02-22

申请号：US18239724

申请日：2023-08-29

Applicant: GOOGLE LLC

Inventor： Yuval Baror ,  Michael Andrew Goodman ,  Praveen Krishnakumar

IPC: H04M3/436 ,  H04M3/42 ,  G10L15/22 ,  H04M3/51 ,  H04M3/428 ,  H04M3/493

CPC classification number: H04M3/436 ,  H04M3/42059 ,  G10L15/22 ,  H04M3/5158 ,  H04M3/42042 ,  H04M3/5166 ,  H04M3/4283 ,  H04M3/4936 ,  H04M3/5183 ,  H04M2201/39

Abstract: Implementations are directed to using an assistant to initiate automated telephone calls with entities. Some implementations identify an item of interest, identify a group of entities associated with the item, and initiate the calls with the entities. During a given call with a given entity, the assistant can request a status update regarding the item, and determine a temporal delay before initiating another call with the given entity to request a further status update regarding the item based on information received responsive to the request. Other implementations receive a request to perform an action on behalf of a user, identify a group of entities that can perform the action, and initiate a given call with a given entity. During the given call, the assistant can initiate an additional call with an additional entity, and generate notification(s), for the user, based on result(s) of the given call and/or the additional call.

公开(公告)号：US11907674B1

公开(公告)日：2024-02-20

申请号：US18370683

申请日：2023-09-20

Applicant: GOOGLE LLC

Inventor： Oscar Akerlund ,  Evgeny Sluzhaev ,  Golnaz Ghiasi ,  Thang Luong ,  Yifeng Lu ,  Igor Petrovski ,  Ágoston Weisz ,  Wei Yu ,  Rakesh Shivanna ,  Michael Andrew Goodman ,  Apoorv Kulshreshtha ,  Yu Du ,  Amin Ghafouri ,  Sanil Jain ,  Dustin Tran ,  Vikas Peswani ,  YaGuang Li

IPC: G06F40/00 ,  G06F40/40

CPC classification number: G06F40/40

Abstract: Implementations relate to generating multi-modal response(s) through utilization of large language model(s) (LLM(s)). Processor(s) of a system can: receive natural language (NL) based input, generate a multi-modal response that is responsive to the NL based output, and cause the multi-modal response to be rendered. In some implementations, and in generating the multi-modal response, the processor(s) can process, using a LLM, LLM input (e.g., that includes at least the NL based input) to generate LLM output, and determine, based on the LLM output, textual content for inclusion in the multi-modal response and multimedia content for inclusion in the multi-modal response. In some implementations, the multimedia content can be obtained based on a multimedia content tag that is included in the LLM output and that is indicative of the multimedia content. In various implementations, the multimedia content can be interleaved between segments of the textual content.

公开(公告)号：US11843718B2

公开(公告)日：2023-12-12

申请号：US17690201

申请日：2022-03-09

Applicant: GOOGLE LLC

Inventor： Yuval Baror ,  Michael Andrew Goodman ,  Yoav Tzur

IPC: H04M3/493 ,  G06F16/901 ,  H04M3/51

CPC classification number: H04M3/4936 ,  G06F16/9027 ,  H04M3/5166

Abstract: Implementations are directed to utilizing an assistant to automatically navigate an interactive voice response (IVR) tree to arrive at a target state during an assisted telephone call. The assistant can receive input to initiate the assisted telephone call, identify an entity to engage with, on behalf of the user, and during the assisted telephone call, based on the input, and identify an IVR tree stored in association with the entity. In various implementations, navigation of the IVR tree can be modified based on interaction(s) detected at a client device subsequent to initiating the assisted telephone call. In various implementations, the assisted telephone call can be initiated from a search interface, and the target state can be associated with a given search result. In various implementations, the IVR tree can be dynamic in that only a subset of candidate state(s) of the IVR tree may be available as the target state.

公开(公告)号：US20230367545A1

公开(公告)日：2023-11-16

申请号：US18096453

申请日：2023-01-12

Applicant: GOOGLE LLC

Inventor： Vikram Aggarwal ,  Michael Andrew Goodman

IPC: G06F3/16 ,  G06F9/451 ,  G06Q10/10

CPC classification number: G06F3/167 ,  G06F9/453 ,  G06Q10/10

Abstract: A method includes determining, by an assistant executing at one or more processors, a default group of actions that the assistant is configured to execute in response to receiving a particular audible command. The method includes determining, by the assistant, based on the default group of actions and a user profile associated with a particular user, a custom group of actions that the assistant is configured to execute in response to receiving the particular audible command from the particular user. The method also includes receiving, by the assistant, an indication of the particular audible command, and determining, by the assistant, whether the indication of particular audible command originated from the particular user. The method further includes, responsive to determining that the indication of particular audible command originated from the particular user, executing, by the assistant, each action from the custom group of actions.