公开(公告)号：US20200279564A1

公开(公告)日：2020-09-03

申请号：US16877799

申请日：2020-05-19

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Bo Wang ,  Steve Chen ,  Sunil Vemuri ,  Barnaby James ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F3/16 ,  G06F16/9535 ,  G06F40/30 ,  G10L15/18 ,  G10L15/30

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

公开(公告)号：US20200184974A1

公开(公告)日：2020-06-11

申请号：US16791334

申请日：2020-02-14

Applicant: Google LLC

Inventor： Barnaby James ,  Bo Wang ,  Sunil Vemuri ,  David Schairer ,  Ulas Kirazci ,  Ertan Dogrultan ,  Petar Aleksic

IPC: G10L15/26 ,  G10L15/30 ,  G10L15/18 ,  G10L15/22

Abstract: Implementations relate to dynamically, and in a context-sensitive manner, biasing voice to text conversion. In some implementations, the biasing of voice to text conversions is performed by a voice to text engine of a local agent, and the biasing is based at least in part on content provided to the local agent by a third-party (3P) agent that is in network communication with the local agent. In some of those implementations, the content includes contextual parameters that are provided by the 3P agent in combination with responsive content generated by the 3P agent during a dialog that: is between the 3P agent, and a user of a voice-enabled electronic device; and is facilitated by the local agent. The contextual parameters indicate potential feature(s) of further voice input that is to be provided in response to the responsive content generated by the 3P agent.

公开(公告)号：US20190279626A1

公开(公告)日：2019-09-12

申请号：US16109069

申请日：2018-08-22

Applicant: Google LLC

Inventor： Bo Wang ,  Subbaiah Venkata ,  Chad Yoshikawa ,  Chris Ramsdale ,  Pravir Gupta ,  Alfonso Gomez-Jordana ,  Kevin Yeun ,  Jae Won Seo ,  Lantian Zheng ,  Sang Soo Sung

IPC: G10L15/22 ,  G10L15/30

Abstract: Systems and methods for enabling voice-based interactions with electronic devices can include a data processing system maintaining a plurality of device action data sets and a respective identifier for each device action data set. The data processing system can receive, from an electronic device, an audio signal representing a voice query and an identifier. The data processing system can identify, using the identifier, a device action data set. The data processing system can identify a device action from device action data set based on content of the audio signal. The data processing system can then identify, from the device action dataset, a command associated with the device action and send the command to the for execution device for execution.

公开(公告)号：US20180096283A1

公开(公告)日：2018-04-05

申请号：US15815353

申请日：2017-11-16

Applicant: Google LLC

Inventor： Bo Wang ,  Lei Zhong ,  Barnaby John James ,  Saisuresh Krishnakumaran ,  Robert Stets ,  Bogdan Caprita ,  Valerie Nygaard

IPC: G06Q10/06 ,  G10L15/22 ,  G10L15/08

CPC classification number: G06Q10/063112 ,  G06F16/951 ,  G10L13/00 ,  G10L15/08 ,  G10L15/22 ,  G10L2015/088 ,  G10L2015/223

Abstract: An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; identifying, based on the utterance, a task to be performed; determining a capability level of a first party (1P) agent to perform the task; determining capability levels of respective third party (3P) agents of a plurality of 3P agents to perform the task; responsive to determining that the capability level of the 1P agent does not satisfy a threshold capability level, that a capability level of a particular 3P agent of the plurality of 3P agents is a greatest of the determined capability levels, and that the capability level of the particular 3P agent satisfies the threshold capability level, selecting the particular 3P agent to perform the task; and performing one or more actions determined by the selected agent to perform the task.

公开(公告)号：US11960534B2

公开(公告)日：2024-04-16

申请号：US16341763

申请日：2019-04-08

Applicant: Google LLC

Inventor： Bo Wang ,  Smita Rai ,  Max Ohlendorf ,  Venkat Kotla ,  Chad Yoshikawa ,  Abhinav Taneja ,  Amit Agarwal ,  Chris Ramsdale ,  Chris Turkstra

IPC: G06F16/63 ,  G06F16/632 ,  G06F16/638 ,  G06F21/62

CPC classification number: G06F16/634 ,  G06F16/638 ,  G06F21/6218

Abstract: Coordinating processing of audio queries is provided. A system receives a query. The system provides the query to a first digital assistant component and a second digital assistant component for processing. The system receives a first response to the query from the first digital assistant component, and a second response to the query from the second digital assistant component. The first digital assistant component can be authorized to access a database the second digital assistant component is prohibited from accessing. The system determines, based on a ranking decision function, to select the second response to the query from the second digital assistant component. The system provides, responsive to the selection, the second response from the second digital assistant to a computing device.

公开(公告)号：US20230162735A1

公开(公告)日：2023-05-25

申请号：US18100446

申请日：2023-01-23

Applicant: GOOGLE LLC

Inventor： Ulas Kirazci ,  Bo Wang ,  Steve Chen ,  Sunil Vemuri ,  Barnaby James ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F3/16 ,  G06F16/9535 ,  G06F40/30 ,  G10L15/18 ,  G10L15/30

CPC classification number: G10L15/22 ,  G06F3/167 ,  G06F16/9535 ,  G06F40/30 ,  G10L15/1815 ,  G10L15/1822 ,  G10L15/30 ,  G10L2015/223

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

公开(公告)号：US11314481B2

公开(公告)日：2022-04-26

申请号：US15781787

申请日：2018-05-07

Applicant: Google LLC

Inventor： Bo Wang ,  Venkat Kotla ,  Chad Yoshikawa ,  Chris Ramsdale ,  Pravir Gupta ,  Alfonso Gomez-Jordana ,  Kevin Yeun ,  Jae Won Seo ,  Lantian Zheng ,  Sang Soo Sung

IPC: G06F3/16 ,  G10L15/22 ,  G10L15/26 ,  G10L15/18

Abstract: Systems and methods for enabling voice-based interactions with electronic devices can include a data processing system maintaining a plurality of device action data sets and a respective identifier for each device action data set. The data processing system can receive, from an electronic device, an audio signal representing a voice query and an identifier. The data processing system can identify, using the identifier, a device action data set. The data processing system can identify a device action from device action data set based on content of the audio signal. The data processing system can then identify, from the device action dataset, a command associated with the device action and send the command to the for execution device for execution.

公开(公告)号：US20210134294A1

公开(公告)日：2021-05-06

申请号：US17150139

申请日：2021-01-15

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Bo Wang ,  Steve Chen ,  Sunil Vemuri ,  Barnaby James ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F3/16 ,  G06F16/9535 ,  G06F40/30 ,  G10L15/18 ,  G10L15/30

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

公开(公告)号：US20210082430A1

公开(公告)日：2021-03-18

申请号：US17099130

申请日：2020-11-16

Applicant: Google LLC

Inventor： Bo Wang ,  Sunil Vemuri ,  Nitin Mangesh Shetti ,  Pravir Kumar Gupta ,  Scott B. Huffman ,  Javier Alejandro Rey ,  Jeffrey A. Boortz

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/19

Abstract: Methods, systems, and apparatus, for defining and monitoring an event for a physical entity and the performance of an action in response to the occurrence of the event. A method includes receiving data indicating an event for a physical entity, the event specified in part by a physical environment feature for which the occurrence of the event is to be monitored by the data processing apparatus; receiving data indicating an action associated with the event and to be taken in response to the occurrence of the event; monitoring for the occurrence of the event for the physical entity; and in response to the occurrence of the event, causing the action associated with the event to be performed.

公开(公告)号：US20190279627A1

公开(公告)日：2019-09-12

申请号：US16109229

申请日：2018-08-22

Applicant: Google LLC

Inventor： Bo Wang ,  Subbaiah Venkata ,  Chad Yoshikawa ,  Chris Ramsdale ,  Pravir Gupta ,  Alfonso Gomez-Jordana ,  Kevin Yeun ,  Jae Won Seo ,  Lantian Zheng ,  Sang Soo Sung

IPC: G10L15/22 ,  G06F17/30 ,  G10L15/18 ,  G10L15/30

Abstract: Systems and methods for enabling voice-based interactions with electronic devices can include a data processing system maintaining a plurality of device action data sets and a respective identifier for each device action data set. The data processing system can receive, from an electronic device, an audio signal representing a voice query and an identifier. The data processing system can identify, using the identifier, a device action data set. The data processing system can identify a device action from device action data set based on content of the audio signal. The data processing system can then identify, from the device action dataset, a command associated with the device action and send the command to the for execution device for execution.