公开(公告)号：US12259914B1

公开(公告)日：2025-03-25

申请号：US17240724

申请日：2021-04-26

Applicant: Amazon Technologies, Inc.

Inventor： Yifan Gao ,  Henghui Zhu ,  Ramesh M. Nallapati ,  Patrick Ng ,  Cicero Nogueira Dos Santos ,  Zhiguo Wang ,  Feng Nan ,  Dejiao Zhang ,  Andrew Oliver Arnold ,  Bing Xiang

IPC: G06F16/332 ,  G06F16/3329 ,  G06F40/20 ,  G06N3/045 ,  G06N5/04 ,  G06N20/00

Abstract: Techniques for predicting an answer to a question using a machine learning model are described. In some examples, the model predicts one or more answers to the question by: predicting at least two answers to the question using a first component of the question-answer model from a set of passages, generating, using a second component of the question-answer model, at least one question for each of the predicted at least two answers, and performing roundtrip predictions until each generated question only has one answer.

公开(公告)号：US12007988B2

公开(公告)日：2024-06-11

申请号：US18182303

申请日：2023-03-10

Applicant: Amazon Technologies, Inc.

Inventor： Ramesh M Nallapati ,  Zhiguo Wang ,  Bing Xiang ,  Patrick Ng ,  Yung Haw Wang ,  Mukul Karnik ,  Nanyan Li ,  Sharanabasappa Parashuram Revadigar ,  Timothy Jones ,  Stephen Michael Ash ,  Sudipta Sengupta ,  Gregory David Adams ,  Deepak Shantha Murthy ,  Douglas Scott Cerny ,  Stephanie Weeks ,  Hanbo Li

IPC: G06F16/2452 ,  G06F16/242 ,  G06F40/295 ,  G06N20/00

CPC classification number: G06F16/24522 ,  G06F16/2423 ,  G06F16/243 ,  G06F40/295 ,  G06N20/00

Abstract: Interactive assistances for executing natural language queries to data sets may be performed. A natural language query may be received. Candidate entity linkages may be determined between an entity recognized in the natural language query and columns in data sets. The candidate linkages may be ranked according to confidence scores which may be evaluated to detect ambiguity for an entity linkage. Candidate entity linkages may be provided to a user via an interface to select an entity linkage to use as part of completing the natural language query.

公开(公告)号：US20230419036A1

公开(公告)日：2023-12-28

申请号：US17847118

申请日：2022-06-22

Applicant: Amazon Technologies, Inc.

Inventor： Zijian Wang ,  Yuchen Tian ,  Mingyue Shang ,  Praphruetpong Athiwaratkun ,  Ming Tan ,  Parminder Bhatia ,  Andrew Oliver Arnold ,  Ramesh M Nallapati ,  Sudipta Sengupta ,  Bing Xiang ,  Atul Deo ,  Ankur Deepak Desai

IPC: G06F40/284 ,  G06N20/00 ,  G06F8/41 ,  G06F8/30

CPC classification number: G06F40/284 ,  G06N20/00 ,  G06F8/427 ,  G06F8/30

Abstract: Random token segmentation may be implemented for next token prediction. Text data may be received for training a machine learning model to predict a next token given input text tokens. Multiple tokens may be determined from the text data. Different ones of the multiple token may be randomly segmented in to sub-tokens. The machine learning model may then be trained using the multiple tokens including the respective sub-tokens as a training data set.

公开(公告)号：US11726994B1

公开(公告)日：2023-08-15

申请号：US17219694

申请日：2021-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Jun Wang ,  Zhiguo Wang ,  Sharanabasappa Parashuram Revadigar ,  Ramesh M Nallapati ,  Bing Xiang ,  Sudipta Sengupta ,  Yung Haw Wang

IPC: G06F16/242 ,  G06F16/2452 ,  G06F16/28 ,  G06F16/248 ,  G06F16/2457

CPC classification number: G06F16/243 ,  G06F16/248 ,  G06F16/24522 ,  G06F16/24573 ,  G06F16/287

Abstract: Query restatements may be provided for explaining natural language query results. A natural language query is received at a natural language query processing system. An intermediate representation of the natural language query is generated for executing the natural language query. The intermediate representation is translated into a natural language restatement of the natural language query. The natural language restatement is provided with a result of the natural language query via an interface of the natural language query processing system.

公开(公告)号：US11500865B1

公开(公告)日：2022-11-15

申请号：US17219706

申请日：2021-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Jun Wang ,  Zhiguo Wang ,  Sharanabasappa Parashuram Revadigar ,  Ramesh M Nallapati ,  Bing Xiang ,  Stephen Michael Ash ,  Timothy Jones ,  Sudipta Sengupta ,  Rishav Chakravarti ,  Patrick Ng ,  Jiarong Jiang ,  Hanbo Li ,  Donald Harold Rivers Weidner

IPC: G06F7/00 ,  G06F16/2452 ,  G06F40/295 ,  G06N20/00 ,  G06F16/242

Abstract: Multiple stage filtering may be implemented for natural language query processing pipelines. Natural language queries may be received at a natural language query processing system and processed through a query language processing pipeline. The query language processing pipeline may filter candidate linkages for a natural language query before performing further filtering of the candidate linkages in the natural language query processing pipeline as part of generating an intermediate representation used to execute the natural language query.

公开(公告)号：US11726997B2

公开(公告)日：2023-08-15

申请号：US18055384

申请日：2022-11-14

Applicant: Amazon Technologies, Inc.

Inventor： Jun Wang ,  Zhiguo Wang ,  Sharanabasappa Parashuram Revadigar ,  Ramesh M Nallapati ,  Bing Xiang ,  Stephen Michael Ash ,  Timothy Jones ,  Sudipta Sengupta ,  Rishav Chakravarti ,  Patrick Ng ,  Jiarong Jiang ,  Hanbo Li ,  Donald Harold Rivers Weidner

IPC: G06F7/00 ,  G06F16/2452 ,  G06F40/295 ,  G06N20/00 ,  G06F16/242

CPC classification number: G06F16/24522 ,  G06F16/243 ,  G06F40/295 ,  G06N20/00

Abstract: Multiple stage filtering may be implemented for natural language query processing pipelines. Natural language queries may be received at a natural language query processing system and processed through a query language processing pipeline. The query language processing pipeline may filter candidate linkages for a natural language query before performing further filtering of the candidate linkages in the natural language query processing pipeline as part of generating an intermediate representation used to execute the natural language query.

公开(公告)号：US20230078177A1

公开(公告)日：2023-03-16

申请号：US18055384

申请日：2022-11-14

Applicant: Amazon Technologies, Inc.

Inventor： Jun Wang ,  Zhiguo Wang ,  Sharanabasappa Parashuram Revadigar ,  Ramesh M Nallapati ,  Bing Xiang ,  Stephen Michael Ash ,  Timothy Jones ,  Sudipta Sengupta ,  Rishav Chakravarti ,  Patrick Ng ,  Jiarong Jiang ,  Hanbo Li ,  Donald Harold Rivers Weidner

IPC: G06F16/2452 ,  G06F40/295 ,  G06N20/00 ,  G06F16/242

Abstract: Multiple stage filtering may be implemented for natural language query processing pipelines. Natural language queries may be received at a natural language query processing system and processed through a query language processing pipeline. The query language processing pipeline may filter candidate linkages for a natural language query before performing further filtering of the candidate linkages in the natural language query processing pipeline as part of generating an intermediate representation used to execute the natural language query.

公开(公告)号：US11604794B1

公开(公告)日：2023-03-14

申请号：US17219689

申请日：2021-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Ramesh M Nallapati ,  Zhiguo Wang ,  Bing Xiang ,  Patrick Ng ,  Yung Haw Wang ,  Mukul Karnik ,  Nanyan Li ,  Sharanabasappa Parashuram Revadigar ,  Timothy Jones ,  Stephen Michael Ash ,  Sudipta Sengupta ,  Gregory David Adams ,  Deepak Shantha Murthy ,  Douglas Scott Cerny ,  Stephanie Weeks ,  Hanbo Li

IPC: G06F16/245 ,  G06F16/2452 ,  G06F16/242 ,  G06F40/295 ,  G06N20/00

Abstract: Interactive assistances for executing natural language queries to data sets may be performed. A natural language query may be received. Candidate entity linkages may be determined between an entity recognized in the natural language query and columns in data sets. The candidate linkages may be ranked according to confidence scores which may be evaluated to detect ambiguity for an entity linkage. Candidate entity linkages may be provided to a user via an interface to select an entity linkage to use as part of completing the natural language query.

公开(公告)号：US20230418567A1

公开(公告)日：2023-12-28

申请号：US17847115

申请日：2022-06-22

Applicant: Amazon Technologies, Inc.

Inventor： Praphruetpong Athiwaratkun ,  Yuchen Tian ,  Mingyue Shang ,  Zijian Wang ,  Ramesh M. Nallapati ,  Parminder Bhatia ,  Andrew Oliver Arnold ,  Bing Xiang ,  Sudipta Sengupta ,  Yanitsa Donchev ,  Srinivas Iragavarapu ,  Matthew Lee ,  Vamshidhar Krishnamurthy Dantu ,  Atul Deo ,  Ankur Deepak Desai

IPC: G06F8/33

CPC classification number: G06F8/33

Abstract: Pre-fix matching may constrain the generation of next token predictions. Input text to perform a next token prediction may be received. Multiple tokens may be determined from the input text, including a partial token. From possible tokens, one or more matching possible tokens with the partial token may be identified. Next token predictions may then be filtered using the identified possible tokens in order to ensure that the partial token is matched.

公开(公告)号：US11366855B2

公开(公告)日：2022-06-21

申请号：US16697948

申请日：2019-11-27

Applicant: Amazon Technologies, Inc.

Inventor： Jean-Pierre Dodel ,  Zhiheng Huang ,  Xiaofei Ma ,  Ramesh M. Nallapati ,  Krishnakumar Rajagopalan ,  Milan Saini ,  Sudipta Sengupta ,  Saurabh Kumar Singh ,  Dimitrios Soulios ,  Ankit Sultania ,  Dong Wang ,  Zhiguo Wang ,  Bing Xiang ,  Peng Xu ,  Yong Yuan

IPC: G06F16/00 ,  G06F16/901 ,  G06N3/04 ,  G06F16/2457 ,  G06F16/903

Abstract: Techniques for searching documents are described. An exemplary method includes receiving a document search query; querying at least one index based upon the document search query to identify matching data; fetching the identified matched data; determining one or more of a top ranked passage and top ranked documents from the set of documents based upon one or more invocations of one or more machine learning models based at least on the fetched identified matched data and the document search query; and returning one or more of the top ranked passage and the proper subset of documents.