Contextual information for a displayed resource that includes an image

    公开(公告)号:US11507253B2

    公开(公告)日:2022-11-22

    申请号:US17063212

    申请日:2020-10-05

    Applicant: Google LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing contextual information for a displayed resource that includes an image. In one aspect, a method includes providing, by a user device to a contextual information server, a query-independent request for contextual information relevant to an active resource displayed in an application environment on the user device, wherein the request specifies content of the active resource and further specifies that the active resource displayed on the user device includes an image, but does not include the image in the request, receiving a request for the image from the contextual information server, providing the image to the contextual information server, receiving a user interface element that includes contextual information regarding the image, and displaying the user interface element on the user device with the active resource.

    MULTIPLE DIGITAL ASSISTANT COORDINATION IN VEHICULAR ENVIRONMENTS

    公开(公告)号:US20220343912A1

    公开(公告)日:2022-10-27

    申请号:US17861615

    申请日:2022-07-11

    Applicant: GOOGLE LLC

    Abstract: The present disclosure is generally related to a data processing system to selectively invoke applications for execution. A data processing system can receive an input audio signal and can parse the input audio signal to identify a command. The data processing system can identify a first functionality of a first digital assistant application hosted on the data processing system in the vehicle and a second functionality of a second digital assistant application accessible via a client device. The data processing system can determine that one of the first functionality or the second functionality supports the command. The data processing system can select one of the first digital assistant application or the second digital assistant application based on the determination. The data processing system invoke one of the first digital assistant application or the second digital assistant application based on the selection.

    MODALITIES FOR AUTHORIZING ACCESS WHEN OPERATING AN AUTOMATED ASSISTANT ENABLED VEHICLE

    公开(公告)号:US20220227383A1

    公开(公告)日:2022-07-21

    申请号:US17716108

    申请日:2022-04-08

    Applicant: GOOGLE LLC

    Abstract: Implementations relate to enabling of authorization of certain automated assistant functions via one or more modalities available within a vehicle. Implementations can eliminate wasting of computational and communication resources by at least allowing other users to authorize execution of certain input commands from a user, without requesting the user to re-submit the commands. The vehicle can include a computing device that provides access to restricted data, which can be accessed in order for an action to be performed by the automated assistant. However, when a restricted user requests that the automated assistant perform an action involving accessing the restricted data, the automated assistant can be authorized or unauthorized to proceed with fulfilling the request via a modality controlled by an unrestricted user. The unrestricted user can also cause contextual restrictions to be established for limiting functionality of the automated assistant during a trip, for certain types of requests, and/or for certain passengers.

    Providing suggested voice-based action queries

    公开(公告)号:US11238851B2

    公开(公告)日:2022-02-01

    申请号:US16586612

    申请日:2019-09-27

    Applicant: Google LLC

    Abstract: Technology of the disclosure may facilitate user discovery of various voice-based action queries that can be spoken to initiate computer-based actions, such as voice-based action queries that can be provided as spoken input to a computing device to initiate computer-based actions that are particularized to content being viewed or otherwise consumed by the user on the computing device. Some implementations are generally directed to determining, in view of content recently viewed by a user on a computing device, at least one suggested voice-based action query for presentation via the computing device. Some implementations are additionally or alternatively generally directed to receiving at least one suggested voice-based action query at a computing device and providing the suggested voice-based action query as a suggestion in response to input to initiate providing of a voice-based query via the computing device.

    VIRTUAL ASSISTANT CONFIGURED TO RECOMMENDED ACTIONS IN FURTHERANCE OF AN EXISTING CONVERSATION

    公开(公告)号:US20220027703A1

    公开(公告)日:2022-01-27

    申请号:US17497189

    申请日:2021-10-08

    Applicant: GOOGLE LLC

    Inventor: Vikram Aggarwal

    Abstract: A system is described that determines, based on information associated with a user of a computing device, an event for initiating an interaction between the user and an assistant executing at the computing device. The system selects, based on the event and from a plurality of actions performed by the assistant, at least one action associated with the event. The system determines, based on the at least one action, whether to output a notification of the event which includes an indication of the event and a request to perform the at least one action associated with the event. Responsive to determining to output the notification of the event, the system sends, to the assistant, the notification of the event for output during the interaction between the user and the assistant

    SYSTEMS, METHODS, AND APPARATUSES FOR MANAGING INCOMPLETE AUTOMATED ASSISTANT ACTIONS

    公开(公告)号:US20220005476A1

    公开(公告)日:2022-01-06

    申请号:US17477705

    申请日:2021-09-17

    Applicant: GOOGLE LLC

    Abstract: Methods, apparatus, systems, and computer-readable media are provided for resuming a partially completed action that is to be performed by an automated assistant. The action can require the automated assistant to prompt the user to provide information that the automated assistant can use to complete the action. During a dialog session in which the user is providing the information, an event can occur that interferes with the completion of the action. In response, the automated assistant can cause any information obtained during the dialog session to be stored locally, in order that the automated assistant can resume completing the action at a later time. For instance, the user can be prompted by the automated assistant to complete the action, or the user can independently invoke the automated assistant to complete the action at a time that is convenient for the user.

    ISOLATING A DEVICE, FROM MULTIPLE DEVICES IN AN ENVIRONMENT, FOR BEING RESPONSIVE TO SPOKEN ASSISTANT INVOCATION(S)

    公开(公告)号:US20220005475A1

    公开(公告)日:2022-01-06

    申请号:US17476774

    申请日:2021-09-16

    Applicant: Google LLC

    Abstract: Methods, apparatus, systems, and computer-readable media are provided for isolating at least one device, from multiple devices in an environment, for being responsive to assistant invocations (e.g., spoken assistant invocations). A process for isolating a device can be initialized in response to a single instance of a spoken utterance, of a user, that is detected by multiple devices. One or more of the multiple devices can be caused to query the user regarding identifying a device to be isolated for receiving subsequent commands. The user can identify the device to be isolated by, for example, describing a unique identifier for the device. Unique identifiers can be generated by each device of the multiple devices and/or by a remote server device. The unique identifiers can be presented graphically and/or audibly to the user, and user interface input. Any device that is not identified can become temporarily unresponsive to certain commands, such as spoken invocation commands.

    Systems, methods, and apparatuses for managing incomplete automated assistant actions

    公开(公告)号:US11170773B2

    公开(公告)日:2021-11-09

    申请号:US16343948

    申请日:2018-04-13

    Applicant: Google LLC

    Abstract: Methods, apparatus, systems, and computer-readable media are provided for resuming a partially completed action that is to be performed by an automated assistant. The action can require the automated assistant to prompt the user to provide information that the automated assistant can use to complete the action. During a dialog session in which the user is providing the information, an event can occur that interferes with the completion of the action. In response, the automated assistant can cause any information obtained during the dialog session to be stored locally, in order that the automated assistant can resume completing the action at a later time. For instance, the user can be prompted by the automated assistant to complete the action, or the user can independently invoke the automated assistant to complete the action at a time that is convenient for the user.

    AUTOMATED ASSISTANT SUGGESTIONS FOR THIRD-PARTY VEHICLE COMPUTING DEVICES WITH RESTRICTED ARCHITECTURE

    公开(公告)号:US20210255828A1

    公开(公告)日:2021-08-19

    申请号:US17306443

    申请日:2021-05-03

    Applicant: Google LLC

    Abstract: Implementations set forth herein relate an automated assistant that provides suggestion elements at an OEM application and/or third-party application that is accessible via an OEM vehicle computing device, which employs restrictions on communications between local applications. The automated assistant can render suggestions via OEM vehicle applications and/or third-party applications, and initialize actions for performance via the OEM vehicle applications and/or the third-party applications—despite the limitations. The suggestions can be rendered at a graphical user interface of a vehicle, and include content that, when spoken by a user, causes the automated assistant to initialize such actions. Actions that are suggested by the automated assistant can be performed by third-party applications that are different from a third-party application that is rendering the suggestion. In this way, a common automated assistant can be indiscriminately available via various vehicle computing devices, despite differences in restrictions of communications between vehicle applications.

    CONTEXTUAL INFORMATION FOR A DISPLAYED RESOURCE THAT INCLUDES AN IMAGE

    公开(公告)号:US20210019026A1

    公开(公告)日:2021-01-21

    申请号:US17063212

    申请日:2020-10-05

    Applicant: Google LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing contextual information for a displayed resource that includes an image. In one aspect, a method includes providing, by a user device to a contextual information server, a query-independent request for contextual information relevant to an active resource displayed in an application environment on the user device, wherein the request specifies content of the active resource and further specifies that the active resource displayed on the user device includes an image, but does not include the image in the request, receiving a request for the image from the contextual information server, providing the image to the contextual information server, receiving a user interface element that includes contextual information regarding the image, and displaying the user interface element on the user device with the active resource.

Patent Agency Ranking