-
公开(公告)号:US11507253B2
公开(公告)日:2022-11-22
申请号:US17063212
申请日:2020-10-05
Applicant: Google LLC
Inventor: Joao Paulo Pagaime da Silva , Vikram Aggarwal
IPC: G06F16/24 , G06F3/0482 , G06F16/248 , G06F16/951 , G06F16/9535 , G06F16/2457 , H04L67/01 , H04W88/02
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing contextual information for a displayed resource that includes an image. In one aspect, a method includes providing, by a user device to a contextual information server, a query-independent request for contextual information relevant to an active resource displayed in an application environment on the user device, wherein the request specifies content of the active resource and further specifies that the active resource displayed on the user device includes an image, but does not include the image in the request, receiving a request for the image from the contextual information server, providing the image to the contextual information server, receiving a user interface element that includes contextual information regarding the image, and displaying the user interface element on the user device with the active resource.
-
公开(公告)号:US20220343912A1
公开(公告)日:2022-10-27
申请号:US17861615
申请日:2022-07-11
Applicant: GOOGLE LLC
Inventor: Haris Ramic , Vikram Aggarwal , Moises Morgenstern Gali , Brandon Stuut
Abstract: The present disclosure is generally related to a data processing system to selectively invoke applications for execution. A data processing system can receive an input audio signal and can parse the input audio signal to identify a command. The data processing system can identify a first functionality of a first digital assistant application hosted on the data processing system in the vehicle and a second functionality of a second digital assistant application accessible via a client device. The data processing system can determine that one of the first functionality or the second functionality supports the command. The data processing system can select one of the first digital assistant application or the second digital assistant application based on the determination. The data processing system invoke one of the first digital assistant application or the second digital assistant application based on the selection.
-
公开(公告)号:US20220227383A1
公开(公告)日:2022-07-21
申请号:US17716108
申请日:2022-04-08
Applicant: GOOGLE LLC
Inventor: Vikram Aggarwal , Moises Morgenstern Gali
Abstract: Implementations relate to enabling of authorization of certain automated assistant functions via one or more modalities available within a vehicle. Implementations can eliminate wasting of computational and communication resources by at least allowing other users to authorize execution of certain input commands from a user, without requesting the user to re-submit the commands. The vehicle can include a computing device that provides access to restricted data, which can be accessed in order for an action to be performed by the automated assistant. However, when a restricted user requests that the automated assistant perform an action involving accessing the restricted data, the automated assistant can be authorized or unauthorized to proceed with fulfilling the request via a modality controlled by an unrestricted user. The unrestricted user can also cause contextual restrictions to be established for limiting functionality of the automated assistant during a trip, for certain types of requests, and/or for certain passengers.
-
公开(公告)号:US11238851B2
公开(公告)日:2022-02-01
申请号:US16586612
申请日:2019-09-27
Applicant: Google LLC
Inventor: Vikram Aggarwal , Pravir Kumar Gupta
Abstract: Technology of the disclosure may facilitate user discovery of various voice-based action queries that can be spoken to initiate computer-based actions, such as voice-based action queries that can be provided as spoken input to a computing device to initiate computer-based actions that are particularized to content being viewed or otherwise consumed by the user on the computing device. Some implementations are generally directed to determining, in view of content recently viewed by a user on a computing device, at least one suggested voice-based action query for presentation via the computing device. Some implementations are additionally or alternatively generally directed to receiving at least one suggested voice-based action query at a computing device and providing the suggested voice-based action query as a suggestion in response to input to initiate providing of a voice-based query via the computing device.
-
15.
公开(公告)号:US20220027703A1
公开(公告)日:2022-01-27
申请号:US17497189
申请日:2021-10-08
Applicant: GOOGLE LLC
Inventor: Vikram Aggarwal
Abstract: A system is described that determines, based on information associated with a user of a computing device, an event for initiating an interaction between the user and an assistant executing at the computing device. The system selects, based on the event and from a plurality of actions performed by the assistant, at least one action associated with the event. The system determines, based on the at least one action, whether to output a notification of the event which includes an indication of the event and a request to perform the at least one action associated with the event. Responsive to determining to output the notification of the event, the system sends, to the assistant, the notification of the event for output during the interaction between the user and the assistant
-
公开(公告)号:US20220005476A1
公开(公告)日:2022-01-06
申请号:US17477705
申请日:2021-09-17
Applicant: GOOGLE LLC
Inventor: Vikram Aggarwal , Moises Morgenstern Gali
Abstract: Methods, apparatus, systems, and computer-readable media are provided for resuming a partially completed action that is to be performed by an automated assistant. The action can require the automated assistant to prompt the user to provide information that the automated assistant can use to complete the action. During a dialog session in which the user is providing the information, an event can occur that interferes with the completion of the action. In response, the automated assistant can cause any information obtained during the dialog session to be stored locally, in order that the automated assistant can resume completing the action at a later time. For instance, the user can be prompted by the automated assistant to complete the action, or the user can independently invoke the automated assistant to complete the action at a time that is convenient for the user.
-
公开(公告)号:US20220005475A1
公开(公告)日:2022-01-06
申请号:US17476774
申请日:2021-09-16
Applicant: Google LLC
Inventor: Vikram Aggarwal , Moises Morgenstern Gali
Abstract: Methods, apparatus, systems, and computer-readable media are provided for isolating at least one device, from multiple devices in an environment, for being responsive to assistant invocations (e.g., spoken assistant invocations). A process for isolating a device can be initialized in response to a single instance of a spoken utterance, of a user, that is detected by multiple devices. One or more of the multiple devices can be caused to query the user regarding identifying a device to be isolated for receiving subsequent commands. The user can identify the device to be isolated by, for example, describing a unique identifier for the device. Unique identifiers can be generated by each device of the multiple devices and/or by a remote server device. The unique identifiers can be presented graphically and/or audibly to the user, and user interface input. Any device that is not identified can become temporarily unresponsive to certain commands, such as spoken invocation commands.
-
公开(公告)号:US11170773B2
公开(公告)日:2021-11-09
申请号:US16343948
申请日:2018-04-13
Applicant: Google LLC
Inventor: Vikram Aggarwal , Moises Morgenstern Gali
Abstract: Methods, apparatus, systems, and computer-readable media are provided for resuming a partially completed action that is to be performed by an automated assistant. The action can require the automated assistant to prompt the user to provide information that the automated assistant can use to complete the action. During a dialog session in which the user is providing the information, an event can occur that interferes with the completion of the action. In response, the automated assistant can cause any information obtained during the dialog session to be stored locally, in order that the automated assistant can resume completing the action at a later time. For instance, the user can be prompted by the automated assistant to complete the action, or the user can independently invoke the automated assistant to complete the action at a time that is convenient for the user.
-
19.
公开(公告)号:US20210255828A1
公开(公告)日:2021-08-19
申请号:US17306443
申请日:2021-05-03
Applicant: Google LLC
Inventor: Vinod Krishnan , Vikram Aggarwal
IPC: G06F3/16 , G06F3/0481
Abstract: Implementations set forth herein relate an automated assistant that provides suggestion elements at an OEM application and/or third-party application that is accessible via an OEM vehicle computing device, which employs restrictions on communications between local applications. The automated assistant can render suggestions via OEM vehicle applications and/or third-party applications, and initialize actions for performance via the OEM vehicle applications and/or the third-party applications—despite the limitations. The suggestions can be rendered at a graphical user interface of a vehicle, and include content that, when spoken by a user, causes the automated assistant to initialize such actions. Actions that are suggested by the automated assistant can be performed by third-party applications that are different from a third-party application that is rendering the suggestion. In this way, a common automated assistant can be indiscriminately available via various vehicle computing devices, despite differences in restrictions of communications between vehicle applications.
-
公开(公告)号:US20210019026A1
公开(公告)日:2021-01-21
申请号:US17063212
申请日:2020-10-05
Applicant: Google LLC
Inventor: Joao Paulo Pagaime da Silva , Vikram Aggarwal
IPC: G06F3/0482 , G06F16/248 , G06F16/951 , G06F16/9535 , G06F16/2457 , H04L29/06
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing contextual information for a displayed resource that includes an image. In one aspect, a method includes providing, by a user device to a contextual information server, a query-independent request for contextual information relevant to an active resource displayed in an application environment on the user device, wherein the request specifies content of the active resource and further specifies that the active resource displayed on the user device includes an image, but does not include the image in the request, receiving a request for the image from the contextual information server, providing the image to the contextual information server, receiving a user interface element that includes contextual information regarding the image, and displaying the user interface element on the user device with the active resource.
-
-
-
-
-
-
-
-
-