公开(公告)号：US12014155B2

公开(公告)日：2024-06-18

申请号：US17847115

申请日：2022-06-22

Applicant: Amazon Technologies, Inc.

Inventor： Praphruetpong Athiwaratkun ,  Yuchen Tian ,  Mingyue Shang ,  Zijian Wang ,  Ramesh M Nallapati ,  Parminder Bhatia ,  Andrew Oliver Arnold ,  Bing Xiang ,  Sudipta Sengupta ,  Yanitsa Donchev ,  Srinivas Iragavarapu ,  Matthew Lee ,  Vamshidhar Krishnamurthy Dantu ,  Atul Deo ,  Ankur Deepak Desai

IPC: G06F8/33

CPC classification number: G06F8/33

Abstract: Pre-fix matching may constrain the generation of next token predictions. Input text to perform a next token prediction may be received. Multiple tokens may be determined from the input text, including a partial token. From possible tokens, one or more matching possible tokens with the partial token may be identified. Next token predictions may then be filtered using the identified possible tokens in order to ensure that the partial token is matched.

公开(公告)号：US20230418567A1

公开(公告)日：2023-12-28

申请号：US17847115

申请日：2022-06-22

Applicant: Amazon Technologies, Inc.

Inventor： Praphruetpong Athiwaratkun ,  Yuchen Tian ,  Mingyue Shang ,  Zijian Wang ,  Ramesh M. Nallapati ,  Parminder Bhatia ,  Andrew Oliver Arnold ,  Bing Xiang ,  Sudipta Sengupta ,  Yanitsa Donchev ,  Srinivas Iragavarapu ,  Matthew Lee ,  Vamshidhar Krishnamurthy Dantu ,  Atul Deo ,  Ankur Deepak Desai

IPC: G06F8/33

CPC classification number: G06F8/33

Abstract: Pre-fix matching may constrain the generation of next token predictions. Input text to perform a next token prediction may be received. Multiple tokens may be determined from the input text, including a partial token. From possible tokens, one or more matching possible tokens with the partial token may be identified. Next token predictions may then be filtered using the identified possible tokens in order to ensure that the partial token is matched.