公开(公告)号：US12175966B1

公开(公告)日：2024-12-24

申请号：US17361003

申请日：2021-06-28

Applicant: Amazon Technologies, Inc.

Inventor： Yi-An Lai ,  Yi Zhang ,  Roger Scott Jenke ,  Meghana Puvvadi ,  Shang-Wen Daniel Li ,  Peng Zhang ,  Jason P. Krone ,  Garima Lalwani ,  Niranjhana Nayar ,  Kartik Natarajan

IPC: G10L15/22 ,  G06N5/04 ,  G06N20/00 ,  G10L15/06 ,  G10L15/18 ,  H04L51/02 ,  G10L15/16

Abstract: Techniques for updating a machine learning model based on user interactions are described. In particular, in some examples, user interactions with a chatbot provide aspects of a data set to be used to train or fine-tune a ML model. In some examples, this is accomplished by collecting data from a first plurality of interactions with a machine learning (ML) model; generating a variant of the ML model using the collected data by: filtering the collected data to create a first data set, training the ML model based on the first data set to generate an adapted ML model, and fine-tuning the adapted ML model on a second data set, different than the first data set to generate the variant of the ML model.

公开(公告)号：US11341339B1

公开(公告)日：2022-05-24

申请号：US16874582

申请日：2020-05-14

Applicant: Amazon Technologies, Inc.

Inventor： Shang-Wen Daniel Li ,  Meghana Puvvadi ,  Trevor Andrew Morse ,  Roger Scott Jenke ,  Yi Zhang ,  Rama Krishna Sandeep Pokkunuri

IPC: G06F15/00 ,  G10L15/00 ,  G10L13/00 ,  G10L13/06 ,  G06F40/40

Abstract: Techniques for creating and calibrating natural-language understanding (NLU) machine learning models are described. In certain embodiments, a training service tunes parameters of a function, taking the output from an NLU machine learning model as an input of the function, to calibrate the NLU machine learning model's output to optimize the interpretability of the resulting output, e.g., confidence score(s). Embodiments herein include generating, by the NLU machine learning model, an output based at least in part on an input (e.g., utterance) from a user, and applying a tuned, output modifying function to the output from the NLU machine learning model to generate a modified output. An inference may be generated based at least in part on the modified output.