Machine learning ranking system
    31.
    发明授权

    公开(公告)号:US12260303B2

    公开(公告)日:2025-03-25

    申请号:US17178365

    申请日:2021-02-18

    Abstract: Techniques are disclosed for training a machine learning model to identify and rank entities relative to a set of requirements. The trained machine learning model may present an array of interface elements (e.g., icons) in a graphical user interface (GUI), where the interface elements represent corresponding entities. These interface elements are arranged in the GUI based on their corresponding ranks. The ranks of entities, and therefore the locations of corresponding interface elements are based, at least in part, on a degree of match between values of a subset of entity attributes and a corresponding subset of the set of requirements. The machine learning model may be further trained by receiving a user input that changes a location of a particular user interface element within the graphical user interface displaying the ranked user interface elements.

    STREAM ORCHESTRATION FOR VARIABLE-LENGTH MESSAGE STREAMS

    公开(公告)号:US20250095870A1

    公开(公告)日:2025-03-20

    申请号:US18829927

    申请日:2024-09-10

    Abstract: Techniques are disclosed for stream orchestration for variable-length message streams, including routes specified using an implementation-independent stream orchestration language (SOL). In an example method, a computing system receives a variable-length message, the variable-length message including context information and a payload. The computing system determines, from the context information, routing information that identifies at least one consumer of the variable-length message. The computing system outputs the variable-length message to the consumer.

    INTELLIGENT TASK SCHEDULING AND NOTIFICATION-INITIATED DIGITAL ASSISTANT CONVERSATIONS

    公开(公告)号:US20250095834A1

    公开(公告)日:2025-03-20

    申请号:US18883923

    申请日:2024-09-12

    Abstract: Techniques are disclosed for assisting healthcare providers with common clinical tasks by way of a clinical software application that can be installed on and utilized from various client computing devices. The clinical software application(s) can enable a healthcare provider to record conversations with patients, dictate in natural language, generate patient notes, populate patient records, and perform numerous other clinical functions. Task entries to schedule such tasks may be generated at the express direction of an end user, or one or more machine-learning models may be used to analyze text transcribed from spoken conversations, to identify one or more tasks from dialogue within the text, and to create corresponding task entries. Notification configuration entries may be created and associated with task entries, and may be used to trigger sending of notifications for scheduled tasks at appropriate times. An end user interaction with a notification may initiate a conversation with a digital assistant.

    AUTOMATIC PROMPT ENGINEERING USING A LARGE LANGUAGE MODEL

    公开(公告)号:US20250095807A1

    公开(公告)日:2025-03-20

    申请号:US18883782

    申请日:2024-09-12

    Abstract: Techniques are disclosed for automatically generating prompts. A method comprises accessing first prompts, wherein each of the first prompts is a prompt for generating a portion of a SOAP note using a machine-learning model. For each respective first prompt of the first prompts: (i) using the respective first prompt to obtain a first result from a first machine-learning model, (ii) using the respective first prompt and the first result to obtain a second result from a second machine-learning model, the second result including an assessment of the first result, (iii) using the second result to obtain a third result from a third machine-learning model, the third result including a second prompt, (iv) setting the second prompt as the respective first prompt, (v) repeating steps (i)-(iv) a number of times to obtain a production prompt, (vi) adding the production prompt to a collection of prompts; and storing the collection of prompts.

    FAIRNESS FEATURE IMPORTANCE: UNDERSTANDING AND MITIGATING UNJUSTIFIABLE BIAS IN MACHINE LEARNING MODELS

    公开(公告)号:US20250094862A1

    公开(公告)日:2025-03-20

    申请号:US18529182

    申请日:2023-12-05

    Abstract: In an embodiment, a computer generates a respective original inference from each of many records. Permuted values are selected for a feature from original values of the feature. Based on the permuted values for the feature, a permuted inference is generated from each record. Fairness and accuracy of the original and permuted inferences are measured. For each of many features, the computer measures a respective impact on fairness of a machine learning model, and a respective impact on accuracy of the machine learning model. A global explanation of the machine learning model is generated and presented based on, for multiple features, the impacts on fairness and accuracy. Based on the global explanation, an interactive indication to exclude or include a particular feature is received. The machine learning model is (re-)trained based on the interactive indication to exclude or include the particular feature, which may increase the fairness of the model.

    LARGE LANGUAGE MODEL HANDLING OUT-OF-SCOPE AND OUT-OF-DOMAIN DETECTION FOR DIGITAL ASSISTANT

    公开(公告)号:US20250094734A1

    公开(公告)日:2025-03-20

    申请号:US18885501

    申请日:2024-09-13

    Abstract: Techniques for using a LLM to detect OOS and OOD utterances. In one aspect, a method includes routing an utterance to a skill bot. The skill bot is configured to execute an action for completing a task associated with the utterance, and a workflow associated with the action includes a GenAI component state configured to facilitate completion of at least part of the task. The method further includes inputting a prompt into a GenAI model for processing. The prompt includes the utterance and scope-related elements that teach the GenAI model to output an invalid input variable when the utterance is OOS or OOD. When the GenAI model determines the utterance is OOS or OOD as part of the processing, the response is generated to include the invalid input variable, and the GenAI component state is caused to transition to a different state or workflow based on the response.

    DIGITAL ASSISTANT USING GENERATIVE ARTIFICIAL INTELLIGENCE

    公开(公告)号:US20250094733A1

    公开(公告)日:2025-03-20

    申请号:US18798049

    申请日:2024-08-08

    Abstract: Techniques are disclosed herein for configuring agents for use by digital assistants that use generative artificial intelligence. An agent may be in the form of a container that is configured to have one or more actions that can be executed by a digital assistant. The agent may be configured by initially defining specification parameters for the agent based on natural language input from a user. Configuration information for the one or more assets can be imported into the agent. One or more actions may then be defined for the agent based on importing of the configuration information, the natural language input from the user, or both. A specification document can be generated for the agent and can comprise various description metadata, such as agent, asset, or action metadata, or combinations thereof. The specification document may be stored in a data store that is communicatively coupled to the digital assistant.

    RETURNING REFERENCES FOR ANSWERS GENERATED BY A LANGUAGE MODEL

    公开(公告)号:US20250094717A1

    公开(公告)日:2025-03-20

    申请号:US18885356

    申请日:2024-09-13

    Abstract: Techniques are disclosed for returning references associated with an answer to a query. The techniques include accessing a text portion and identifying a plurality of sentences in the text portion. Each of the sentences is embedded to generate a respective plurality of text sentence embeddings. The text portion or a derivative thereof and a query are provided to a language model and a response to the query based on the text portion is received from the language model. A plurality of sentences are identified in the response. The plurality of sentences in the response is embedded to generate a plurality of response embeddings. The response embeddings are compared to the sentence embeddings to generate a similarity score for each sentence embedding-response embedding pair. Based on the similarity scores, an indication of a subset of the plurality of sentences is output with the response to the query.

    AI-GENERATED DATA OBJECTS FOR DATA VISUALIZATION

    公开(公告)号:US20250094703A1

    公开(公告)日:2025-03-20

    申请号:US18508805

    申请日:2023-11-14

    Abstract: Technology is disclosed herein for generating a visualization of data based on an AI-generated data object. In an implementation, an application, such as a data analytics application, receives a natural language input from a user which relates to a table of data in the application. The table includes data organized according to table columns. The application generates a prompt for a large language model (LLM) service which includes the names of the table columns. The prompt tasks the LLM service with selecting columns for the visualization based on the natural language input and the names of the table columns. The prompt tasks the LLM service with generating a response in a JSON format. The application populates the JSON object, which describes the visualization, according to the response. The application then creates visualization based on the JSON object.

Patent Agency Ranking