公开(公告)号：US20210174238A1

公开(公告)日：2021-06-10

申请号：US16578060

申请日：2019-09-20

Applicant: Amazon Technologies, Inc.

Inventor： Sangil SONG ,  Yongsik YOON ,  Kamal Kant GUPTA ,  Saileshwar KRISHNAMURTHY ,  Stefano STEFANI ,  Sudipta SENGUPTA ,  Jaeyun NOH

IPC: G06N20/00 ,  G06F16/242 ,  G06F16/2453 ,  G06N5/04

Abstract: Techniques for making machine learning inference calls for database query processing are described. In some embodiments, a method of making machine learning inference calls for database query processing may include generating a first batch of machine learning requests based at least on a query to be performed on data stored in a database service, wherein the query identifies a machine learning service, sending the first batch of machine learning requests to an input buffer of an asynchronous request handler, the asynchronous request handler to generate a second batch of machine learning requests based on the first batch of machine learning requests, and obtaining a plurality of machine learning responses from an output buffer of the asynchronous request handler, the machine learning responses generated by the machine learning service using a machine learning model in response to receiving the second batch of machine learning requests.