公开(公告)号：US11449796B2

公开(公告)日：2022-09-20

申请号：US16578060

申请日：2019-09-20

Applicant: Amazon Technologies, Inc.

Inventor： Sangil Song ,  Yongsik Yoon ,  Kamal Kant Gupta ,  Saileshwar Krishnamurthy ,  Stefano Stefani ,  Sudipta Sengupta ,  Jaeyun Noh

IPC: G06F7/00 ,  G06N20/00 ,  G06F16/242 ,  G06F16/2453 ,  G06N5/04

Abstract: Techniques for making machine learning inference calls for database query processing are described. In some embodiments, a method of making machine learning inference calls for database query processing may include generating a first batch of machine learning requests based at least on a query to be performed on data stored in a database service, wherein the query identifies a machine learning service, sending the first batch of machine learning requests to an input buffer of an asynchronous request handler, the asynchronous request handler to generate a second batch of machine learning requests based on the first batch of machine learning requests, and obtaining a plurality of machine learning responses from an output buffer of the asynchronous request handler, the machine learning responses generated by the machine learning service using a machine learning model in response to receiving the second batch of machine learning requests.

公开(公告)号：US11775868B1

公开(公告)日：2023-10-03

申请号：US17884955

申请日：2022-08-10

Applicant: Amazon Technologies, Inc.

Inventor： Sangil Song ,  Yongsik Yoon ,  Kamal Kant Gupta ,  Saileshwar Krishnamurthy ,  Stefano Stefani ,  Sudipta Sengupta ,  Jaeyun Noh

IPC: G06F7/00 ,  G06N20/00 ,  G06F16/242 ,  G06F16/2453 ,  G06N5/04

CPC classification number: G06N20/00 ,  G06F16/2433 ,  G06F16/24542 ,  G06N5/04

Abstract: Techniques for making machine learning inference calls for database query processing are described. In some embodiments, a method of making machine learning inference calls for database query processing may include generating a first batch of machine learning requests based at least on a query to be performed on data stored in a database service, wherein the query identifies a machine learning service, sending the first batch of machine learning requests to an input buffer of an asynchronous request handler, the asynchronous request handler to generate a second batch of machine learning requests based on the first batch of machine learning requests, and obtaining a plurality of machine learning responses from an output buffer of the asynchronous request handler, the machine learning responses generated by the machine learning service using a machine learning model in response to receiving the second batch of machine learning requests.