公开(公告)号：US11989229B2

公开(公告)日：2024-05-21

申请号：US16341763

申请日：2019-04-08

Applicant: Google LLC

Inventor： Bo Wang ,  Smita Rai ,  Max Ohlendorf ,  Venkat Kotla ,  Chad Yoshikawa ,  Abhinav Taneja ,  Amit Agarwal ,  Chris Ramsdale ,  Chris Turkstra

IPC: G06F16/63 ,  G06F16/632 ,  G06F16/638 ,  G06F21/62

CPC classification number: G06F16/634 ,  G06F16/638 ,  G06F21/6218

Abstract: Coordinating processing of audio queries is provided. A system receives a query. The system provides the query to a first digital assistant component and a second digital assistant component for processing. The system receives a first response to the query from the first digital assistant component, and a second response to the query from the second digital assistant component. The first digital assistant component can be authorized to access a database the second digital assistant component is prohibited from accessing. The system determines, based on a ranking decision function, to select the second response to the query from the second digital assistant component. The system provides, responsive to the selection, the second response from the second digital assistant to a computing device.

公开(公告)号：US11922945B2

公开(公告)日：2024-03-05

申请号：US18125606

申请日：2023-03-23

Applicant: GOOGLE LLC

Inventor： Barnaby James ,  Bo Wang ,  Sunil Vemuri ,  David Schairer ,  Ulas Kirazci ,  Ertan Dogrultan ,  Petar Aleksic

IPC: G10L15/26 ,  G06F40/205 ,  G06F40/284 ,  G06F40/30 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G10L15/30

CPC classification number: G10L15/26 ,  G06F40/205 ,  G06F40/284 ,  G06F40/30 ,  G10L15/1815 ,  G10L15/183 ,  G10L15/22 ,  G10L15/30 ,  G10L2015/223 ,  G10L2015/228

Abstract: Implementations relate to dynamically, and in a context-sensitive manner, biasing voice to text conversion. In some implementations, the biasing of voice to text conversions is performed by a voice to text engine of a local agent, and the biasing is based at least in part on content provided to the local agent by a third-party (3P) agent that is in network communication with the local agent. In some of those implementations, the content includes contextual parameters that are provided by the 3P agent in combination with responsive content generated by the 3P agent during a dialog that: is between the 3P agent, and a user of a voice-enabled electronic device; and is facilitated by the local agent. The contextual parameters indicate potential feature(s) of further voice input that is to be provided in response to the responsive content generated by the 3P agent.

公开(公告)号：US11626115B2

公开(公告)日：2023-04-11

申请号：US17582926

申请日：2022-01-24

Applicant: Google LLC

Inventor： Barnaby James ,  Bo Wang ,  Sunil Vemuri ,  David Schairer ,  Ulas Kirazci ,  Ertan Dogrultan ,  Petar Aleksic

IPC: G10L15/26 ,  G10L15/22 ,  G06F40/284 ,  G06F40/205 ,  G06F40/30 ,  G10L15/183 ,  G10L15/18 ,  G10L15/30

Abstract: Implementations relate to dynamically, and in a context-sensitive manner, biasing voice to text conversion. In some implementations, the biasing of voice to text conversions is performed by a voice to text engine of a local agent, and the biasing is based at least in part on content provided to the local agent by a third-party (3P) agent that is in network communication with the local agent. In some of those implementations, the content includes contextual parameters that are provided by the 3P agent in combination with responsive content generated by the 3P agent during a dialog that: is between the 3P agent, and a user of a voice-enabled electronic device; and is facilitated by the local agent. The contextual parameters indicate potential feature(s) of further voice input that is to be provided in response to the responsive content generated by the 3P agent.

公开(公告)号：US11562742B2

公开(公告)日：2023-01-24

申请号：US17150139

申请日：2021-01-15

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Bo Wang ,  Steve Chen ,  Sunil Vemuri ,  Barnaby James ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F3/16 ,  G06F16/9535 ,  G06F40/30 ,  G10L15/18 ,  G10L15/30

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

公开(公告)号：US20220244910A1

公开(公告)日：2022-08-04

申请号：US17728614

申请日：2022-04-25

Applicant: GOOGLE LLC

Inventor： Bo Wang ,  Venkat Kotla ,  Chad Yoshikawa ,  Chris Ramsdale ,  Pravir Gupta ,  Alfonso Gomez-Jordana ,  Kevin Yeun ,  Jae Won Seo ,  Lantian Zheng ,  Sang Soo Sung

IPC: G06F3/16 ,  G10L15/18 ,  G10L15/26

Abstract: Systems and methods for enabling voice-based interactions with electronic devices can include a data processing system maintaining a plurality of device action data sets and a respective identifier for each device action data set. The data processing system can receive, from an electronic device, an audio signal representing a voice query and an identifier. The data processing system can identify, using the identifier, a device action data set. The data processing system can identify a device action from device action data set based on content of the audio signal. The data processing system can then identify, from the device action dataset, a command associated with the device action and send the command to the for execution device for execution.

公开(公告)号：US11183182B2

公开(公告)日：2021-11-23

申请号：US16109069

申请日：2018-08-22

Applicant: Google LLC

Inventor： Bo Wang ,  Venkat Kotla ,  Chad Yoshikawa ,  Chris Ramsdale ,  Pravir Gupta ,  Alfonso Gomez-Jordana ,  Kevin Yeun ,  Jae Won Seo ,  Lantian Zheng ,  Sang Soo Sung

IPC: G10L15/22 ,  G10L15/30 ,  G10L15/18 ,  G06F16/632 ,  G10L15/08

Abstract: Systems and methods for enabling voice-based interactions with electronic devices can include a data processing system maintaining a plurality of device action data sets and a respective identifier for each device action data set. The data processing system can receive, from an electronic device, an audio signal representing a voice query and an identifier. The data processing system can identify, using the identifier, a device action data set. The data processing system can identify a device action from device action data set based on content of the audio signal. The data processing system can then identify, from the device action dataset, a command associated with the device action and send the command to the for execution device for execution.

公开(公告)号：US10943591B2

公开(公告)日：2021-03-09

申请号：US17063398

申请日：2020-10-05

Applicant: Google LLC

Inventor： Barnaby James ,  Bo Wang ,  Sunil Vemuri ,  David Schairer ,  Ulas Kirazci ,  Ertan Dogrultan ,  Petar Aleksic

IPC: G10L15/26 ,  G10L15/22 ,  G10L15/30 ,  G10L15/18

Abstract: Implementations relate to dynamically, and in a context-sensitive manner, biasing voice to text conversion. In some implementations, the biasing of voice to text conversions is performed by a voice to text engine of a local agent, and the biasing is based at least in part on content provided to the local agent by a third-party (3P) agent that is in network communication with the local agent. In some of those implementations, the content includes contextual parameters that are provided by the 3P agent in combination with responsive content generated by the 3P agent during a dialog that: is between the 3P agent, and a user of a voice-enabled electronic device; and is facilitated by the local agent. The contextual parameters indicate potential feature(s) of further voice input that is to be provided in response to the responsive content generated by the 3P agent.

公开(公告)号：US10937427B2

公开(公告)日：2021-03-02

申请号：US16877799

申请日：2020-05-19

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Bo Wang ,  Steve Chen ,  Sunil Vemuri ,  Barnaby James ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F3/16 ,  G06F16/9535 ,  G06F40/30 ,  G10L15/18 ,  G10L15/30

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

公开(公告)号：US20210026593A1

公开(公告)日：2021-01-28

申请号：US15781787

申请日：2018-05-07

Applicant: Google LLC

Inventor： Bo Wang ,  Subbaiah Venkata ,  Chad Yoshikawa ,  Chris Ramsdale ,  Pravir Gupta ,  Alfonso Gomez-Jordana ,  Kevin Yeun ,  Jae Won Seo ,  Lantian Zheng ,  Sang Soo Sung

IPC: G06F3/16 ,  G10L15/26 ,  G10L15/18

Abstract: Systems and methods for enabling voice-based interactions with electronic devices can include a data processing system maintaining a plurality of device action data sets and a respective identifier for each device action data set. The data processing system can receive, from an electronic device, an audio signal representing a voice query and an identifier. The data processing system can identify, using the identifier, a device action data set. The data processing system can identify a device action from device action data set based on content of the audio signal. The data processing system can then identify, from the device action dataset, a command associated with the device action and send the command to the for execution device for execution.

公开(公告)号：US20210020180A1

公开(公告)日：2021-01-21

申请号：US17063398

申请日：2020-10-05

Applicant: Google LLC

Inventor： Barnaby James ,  Bo Wang ,  Sunil Vemuri ,  David Schairer ,  Ulas Kirazci ,  Ertan Dogrultan ,  Petar Aleksic

IPC: G10L15/26 ,  G10L15/22 ,  G10L15/18 ,  G10L15/30

Abstract: Implementations relate to dynamically, and in a context-sensitive manner, biasing voice to text conversion. In some implementations, the biasing of voice to text conversions is performed by a voice to text engine of a local agent, and the biasing is based at least in part on content provided to the local agent by a third-party (3P) agent that is in network communication with the local agent. In some of those implementations, the content includes contextual parameters that are provided by the 3P agent in combination with responsive content generated by the 3P agent during a dialog that: is between the 3P agent, and a user of a voice-enabled electronic device; and is facilitated by the local agent. The contextual parameters indicate potential feature(s) of further voice input that is to be provided in response to the responsive content generated by the 3P agent.