公开(公告)号：US12141553B2

公开(公告)日：2024-11-12

申请号：US17847113

申请日：2022-06-22

Applicant: Amazon Technologies, Inc.

Inventor： Praphruetpong Athiwaratkun ,  Zixuan Lin ,  Ramana Keerthi ,  Zijian Wang ,  Yuchen Tian ,  Hantian Ding ,  Sri Ranga Akhilesh Bontala ,  Matthew Lee ,  Yanitsa Donchev ,  Ramesh M Nallapati ,  Parminder Bhatia ,  Andrew Oliver Arnold ,  Bing Xiang ,  Sudipta Sengupta ,  Rama Krishna Sandeep Pokkunuri ,  Srinivas Iragavarapu ,  Atul Deo ,  Ankur Deepak Desai

IPC: G06F8/33 ,  G06F8/41 ,  G06F11/36

Abstract: Evaluation data sets may be programmatically generated for code generation models. An evaluation data set is obtained that includes items that correspond to different evaluation tests for a code generation system. The individual items of the evaluation data set maybe converted, including the conversion of a function signature for the items, the test statements for the items and using a code generation system to generate the body of the function.

公开(公告)号：US20230418566A1

公开(公告)日：2023-12-28

申请号：US17847113

申请日：2022-06-22

Applicant: Amazon Technologies, Inc.

Inventor： Praphruetpong Athiwaratkun ,  Zixuan Lin ,  Ramana Keerthi ,  Zijian Wang ,  Yuchen Tian ,  Hantian Ding ,  Sri Ranga Akhilesh Bontala ,  Matthew Lee ,  Yanitsa Donchev ,  Ramesh M Nallapati ,  Parminder Bhatia ,  Andrew Oliver Arnold ,  Bing Xiang ,  Sudipta Sengupta ,  Rama Krishna Sandeep Pokkunuri ,  Srinivas Iragavarapu ,  Atul Deo ,  Ankur Deepak Desai

IPC: G06F8/33 ,  G06F11/36 ,  G06F8/41

CPC classification number: G06F8/33 ,  G06F8/447 ,  G06F11/3608

Abstract: Evaluation data sets may be programmatically generated for code generation models. An evaluation data set is obtained that includes items that correspond to different evaluation tests for a code generation system. The individual items of the evaluation data set maybe converted, including the conversion of a function signature for the items, the test statements for the items and using a code generation system to generate the body of the function.