公开(公告)号：US20180060394A1

公开(公告)日：2018-03-01

申请号：US15470843

申请日：2017-03-27

Applicant: Amazon Technologies, Inc.

Inventor： Pratik Bhagwat Gawande ,  Sumeetkumar Veniklal Maru ,  Bhargava Ram Kalathuru ,  Jian Fang ,  Xing Wu ,  Yuanyuan Yue ,  Turkay Mert Hocanin ,  Jason Douglas Denton ,  Luca Natali ,  Rahul Sharma Pathak ,  Abhishek Rajnikant Sinha ,  Armen Tangamyan ,  Yufeng Jiang ,  Marc Howard Beitchman ,  Andrew Edward Caldwell

IPC: G06F17/30

CPC classification number: G06F16/24545 ,  G06F9/50 ,  G06F9/5022 ,  G06F9/5027 ,  G06F9/5044 ,  G06F9/505 ,  G06F9/5055 ,  G06F9/5061 ,  G06F9/5088 ,  G06F16/20 ,  G06F16/211 ,  G06F16/245 ,  G06F16/24549 ,  G06F16/2455 ,  G06F16/24553 ,  G06F16/2471 ,  G06F16/248 ,  G06F16/25 ,  G06F16/27 ,  G06F16/282 ,  G06F16/90335 ,  G06F2209/501 ,  G06F2209/5011 ,  G06F2209/503 ,  G06F2209/508 ,  H04L29/08135 ,  H04L29/08171 ,  H04L29/08261 ,  H04L29/0827 ,  H04L67/10 ,  H04L67/1008 ,  H04L67/1029 ,  H04L67/1031

Abstract: The configuration of computing resources for executing queries may be selected. A comparison of the configuration of computing resources that executed previous queries may be made to select the configuration of computing resources for a received query. A historical query execution model maybe applied, in some embodiments, to determine a resource configuration for computing resources to execute a query. The computing resources may be selected from available computing resources according to the determined resource configuration.

公开(公告)号：US20180060133A1

公开(公告)日：2018-03-01

申请号：US15470837

申请日：2017-03-27

Applicant: Amazon Technologies, Inc.

Inventor： Jian Fang ,  Xing Wu ,  Bhargava Ram Kalathuru ,  Yuanyuan Yue ,  Pratik Bhagwat Gawande ,  Turkay Mert Hocanin ,  Jason Douglas Denton ,  Luca Natali ,  Rahul Sharma Pathak ,  Abhishek Rajnikant Sinha ,  Sumeetkumar Veniklal Maru ,  Armen Tangamyan ,  Yufeng Jiang

IPC: G06F9/50 ,  H04L29/08 ,  G06F17/30

CPC classification number: G06F16/24545 ,  G06F9/50 ,  G06F9/5022 ,  G06F9/5027 ,  G06F9/5044 ,  G06F9/505 ,  G06F9/5055 ,  G06F9/5061 ,  G06F9/5088 ,  G06F16/20 ,  G06F16/211 ,  G06F16/245 ,  G06F16/24549 ,  G06F16/2455 ,  G06F16/24553 ,  G06F16/2471 ,  G06F16/248 ,  G06F16/25 ,  G06F16/27 ,  G06F16/282 ,  G06F16/90335 ,  G06F2209/501 ,  G06F2209/5011 ,  G06F2209/503 ,  G06F2209/508 ,  H04L29/08135 ,  H04L29/08171 ,  H04L29/08261 ,  H04L29/0827 ,  H04L67/10 ,  H04L67/1008 ,  H04L67/1029 ,  H04L67/1031

Abstract: Event-driven management may be implemented for resource pools. Pool management events may be detected at computing resources in a resource pool. Operations based on the pool management events may then be performed at the computing resources. In some embodiments, pool management events may trigger operations to a recycle a computing resource for reuse in a resource pool or perform other resource lifecycle operations.

公开(公告)号：US20180060132A1

公开(公告)日：2018-03-01

申请号：US15470834

申请日：2017-03-27

Applicant: Amazon Technologies, Inc.

Inventor： Sumeetkumar Veniklal Maru ,  Bhargava Ram Kalathuru ,  Jian Fang ,  Xing Wu ,  Yuanyuan Yue ,  Pratik Bhagwat Gawande ,  Turkay Mert Hocanin ,  Jason Douglas Denton ,  Luca Natali ,  Rahul Sharma Pathak ,  Abhishek Rajnikant Sinha ,  Armen Tangamyan ,  Yufeng Jiang

IPC: G06F9/50 ,  H04L29/08 ,  G06F17/30

CPC classification number: G06F16/24545 ,  G06F9/50 ,  G06F9/5022 ,  G06F9/5027 ,  G06F9/5044 ,  G06F9/505 ,  G06F9/5055 ,  G06F9/5061 ,  G06F9/5088 ,  G06F16/20 ,  G06F16/211 ,  G06F16/245 ,  G06F16/24549 ,  G06F16/2455 ,  G06F16/24553 ,  G06F16/2471 ,  G06F16/248 ,  G06F16/25 ,  G06F16/27 ,  G06F16/282 ,  G06F16/90335 ,  G06F2209/501 ,  G06F2209/5011 ,  G06F2209/503 ,  G06F2209/508 ,  H04L29/08135 ,  H04L29/08171 ,  H04L29/08261 ,  H04L29/0827 ,  H04L67/10 ,  H04L67/1008 ,  H04L67/1029 ,  H04L67/1031

Abstract: Stateful resource pool management may be implemented for executing jobs. Metrics for pools of computing resources that are configured to execute jobs on behalf of network-based services may be collected. The metrics may be evaluated to detect a modification event for a pool of computing resources. The pool of computing resources may then be modified according to the detected modification event for the pool. Evaluation of metrics may be performed automatically as part of monitoring a resource pool, in some embodiments.

公开(公告)号：US09703594B1

公开(公告)日：2017-07-11

申请号：US14635254

申请日：2015-03-02

Applicant: Amazon Technologies, Inc.

Inventor： Ankit Kamboj ,  Xing Wu ,  George Steven McPherson ,  Jian Fang ,  Dag Stockstad ,  Abhishek Rajnikant Sinha

IPC: G06F9/46 ,  G06F9/48

CPC classification number: G06F9/4806 ,  G06F9/485 ,  G06F9/4881 ,  G06F9/4887 ,  G06F11/30

Abstract: A system adapted to process long-running processes is disclosed. A request to upload data is received at a server. The server divides the data into multiple parts and launches a separate process to upload each of the divided parts. The server records for each process the processing time or duration that the particular process used to upload its corresponding data item. The server maintains an average processing duration that is calculated from the processing durations of the completed processes. The server identifies that one process is continuing to run and compares a processing duration for the particular process to a threshold derived from the average processing duration. If the processing duration for the particular process exceeds the threshold, the server initiates a new process to upload the same data item. When one of either the new process or the still running process has completed processing, the server terminates the other process.

公开(公告)号：US11461330B2

公开(公告)日：2022-10-04

申请号：US17067495

申请日：2020-10-09

Applicant: Amazon Technologies, Inc.

Inventor： Bhargava Ram Kalathuru ,  Jian Fang ,  Xing Wu ,  Yuanyuan Yue ,  Pratik Bhagwat Gawande ,  Turkay Mert Hocanin ,  Jason Douglas Denton ,  Luca Natali ,  Rahul Sharma Pathak ,  Abhishek Rajnikant Sinha ,  Sumeetkumar Veniklal Maru ,  Armen Tangamyan ,  Yufeng Jiang

IPC: G06F16/20 ,  G06F16/21 ,  G06F16/245 ,  G06F16/2453 ,  G06F16/2455 ,  G06F16/2458 ,  G06F16/248 ,  G06F16/25 ,  G06F16/27 ,  G06F9/50 ,  H04L67/10 ,  H04L67/1008 ,  H04L67/1029 ,  H04L67/1031 ,  G06F16/28 ,  G06F16/903

Abstract: Queries may be received and executed by a managed query service. A query directed to data sets that are separately stored in a remote data store may be received. Computing resources to execute the query may be provisioned from a pool of computing resources that are configured to execute queries. The query may be routed to the provisioned computing resources to execute the query. Results may be obtained from the computing resource and provided to a submitter of the query.

公开(公告)号：US10970303B1

公开(公告)日：2021-04-06

申请号：US15668677

申请日：2017-08-03

Applicant: Amazon Technologies, Inc.

Inventor： Jason Douglas Denton ,  Rahul Sharma Pathak ,  Xing Wu

IPC: G06F16/00 ,  G06F16/27 ,  G06F16/951 ,  G06F16/25

Abstract: Available capacity of resources hosted in different networks may be evaluated to select resources for the performance of a query. A query may be received via an interface for one network. The available capacity of the one network and other networks may be evaluated to select resources hosted in another network to perform the query instead of the resources in the one network. The query may then be routed to the resources in the other network and result of the query performed at the resources in the other network provided.

公开(公告)号：US20210049175A1

公开(公告)日：2021-02-18

申请号：US17006522

申请日：2020-08-28

Applicant: Amazon Technologies, Inc.

Inventor： Xing Wu ,  Bhargava Ram Kalathuru ,  Jian Fang ,  Yuanyuan Yue ,  Pratik Bhagwat Gawande ,  Turkay Mert Hocanin ,  Jason Douglas Denton ,  Luca Natali ,  Rahul Sharma Pathak ,  Abhishek Rajnikant Sinha ,  Sumeetkumar Veniklal Maru ,  Armen Tangamyan ,  Yufeng Jiang

IPC: G06F16/2453 ,  G06F16/21 ,  G06F16/248 ,  G06F16/28 ,  G06F16/2455 ,  G06F16/2458 ,  G06F16/903 ,  G06F9/50 ,  G06F16/27 ,  G06F16/20 ,  G06F16/25 ,  H04L29/08

Abstract: Query execution status may be tracked to selectively route queries to resources for execution. The completion of queries executing at computing resources obtained from a pool of computing resources configured to execute queries may be detected. Instead of returning the computing resources to the pool, the computing resources may be identified as available in resource management data. When another query is received, the resource management data may be evaluated to select an available computing resource. The query may then be routed to the selected computing resource for execution.

公开(公告)号：US20200218701A1

公开(公告)日：2020-07-09

申请号：US16818404

申请日：2020-03-13

Applicant: Amazon Technologies, Inc.

Inventor： Bogdan Eduard Ghidireac ,  Peter Sirota ,  Robert Frederick Leidle ,  Mathew Alan Mills ,  George Steven McPherson ,  Xing Wu ,  Jonathan Andrew Fritz

IPC: G06F16/182

Abstract: Methods and apparatus for providing consistent data storage in distributed computing systems. A consistent distributed computing file system (consistent DCFS) may be backed by an object storage service that only guarantees eventual consistency, and may leverage a data storage service (e.g., a database service) to store and maintain a file system/directory structure (a consistent DCFS directory) for the consistent DCFS that may be accessed by compute nodes for file/directory information relevant to the data objects in the consistent DCFS, rather than relying on the information maintained by the object storage service. The compute nodes may reference the consistent DCFS directory to, for example, store and retrieve strongly consistent metadata referencing data objects in the consistent DCFS. The compute nodes may, for example, retrieve metadata from consistent DCFS directory to determine whether the object storage service is presenting all of the data that it is supposed to have.

公开(公告)号：US10599621B1

公开(公告)日：2020-03-24

申请号：US14611980

申请日：2015-02-02

Applicant: Amazon Technologies, Inc.

Inventor： Xing Wu ,  George Steven McPherson ,  Robert Frederick Leidle ,  Jonathan Andrew Fritz

IPC: G06F17/30 ,  G06F16/182

Abstract: A system and method for improving the speed of generating a list of previously-uncounted items stored with a computing resource service provider. The system and method involve obtaining a set of keys from a data store, wherein each key of the set of keys corresponds to an item in a group of items, wherein a quantity of items in the group is uncounted. The system and method further includes generating a first sub-listing of keys based at least in part on a first key range of the set of keys by executing a first thread, generating a second sub-listing of keys based at least in part on a second key range of the set of keys by executing a second thread, combining the first sub-listing of keys with the second sub-listing of keys to produce a list of keys, and providing the list of keys.

公开(公告)号：US10803060B2

公开(公告)日：2020-10-13

申请号：US15470829

申请日：2017-03-27

Applicant: Amazon Technologies, Inc.

Inventor： Bhargava Ram Kalathuru ,  Jian Fang ,  Xing Wu ,  Yuanyuan Yue ,  Pratik Bhagwat Gawande ,  Turkay Mert Hocanin ,  Jason Douglas Denton ,  Luca Natali ,  Rahul Sharma Pathak ,  Abhishek Rajnikant Sinha ,  Sumeetkumar Veniklal Maru ,  Armen Tangamyan ,  Yufeng Jiang

IPC: G06F16/20 ,  G06F16/21 ,  G06F16/245 ,  G06F16/2453 ,  G06F16/2455 ,  G06F16/2458 ,  G06F16/248 ,  G06F16/25 ,  G06F16/27 ,  G06F16/28 ,  G06F16/903 ,  G06F9/50 ,  H04L29/08

Abstract: Queries may be received and executed by a managed query service. A query directed to data sets that are separately stored in a remote data store may be received. Computing resources to execute the query may be provisioned from a pool of computing resources that are configured to execute queries. The query may be routed to the provisioned computing resources to execute the query. Results may be obtained from the computing resource and provided to a submitter of the query.