-
公开(公告)号:US20220276904A1
公开(公告)日:2022-09-01
申请号:US17698285
申请日:2022-03-18
Applicant: Amazon Technologies, Inc.
Inventor: James Edward Kinney, JR. , Dougal Stuart Ballantyne , Nishant Mehta
Abstract: Methods, systems, and computer-readable media for job execution with managed compute environments are disclosed. A specification of a managed compute environment comprises one or more constraints associated with computing resources in the managed compute environment. A queue or other data structure that is associated with the managed compute environment is monitored. The data structure is configured to store jobs. Data indicative of a job is detected in the data structure. One or more computing resources are reserved for the job from a pool of available computing resources. The one or more computing resources are selected for the job based at least in part on the one or more constraints associated with computing resources in the managed compute environment. Execution of the job using the one or more computing resources is initiated.
-
公开(公告)号:US20200218569A1
公开(公告)日:2020-07-09
申请号:US16818297
申请日:2020-03-13
Applicant: Amazon Technologies, Inc.
Inventor: Dougal Stuart Ballantyne , James Edward Kinney, JR. , Aswin Damodar , Chetan Hosmani , Rejith George Joseph , Chris William Ramsey , Kiuk Chung , Jason Roy Rupard
Abstract: A scheduler of a batch job management service determines that a set of resources a client is insufficient to execute one or more jobs. The scheduler prepares a multi-dimensional statistical representation of resource requirements of the jobs, and transmits it to a resource controller. The resource controller uses the multi-dimensional representation and resource usage state information to make resource allocation change decisions.
-
公开(公告)号:US20200151025A1
公开(公告)日:2020-05-14
申请号:US16739870
申请日:2020-01-10
Applicant: Amazon Technologies, Inc.
Inventor: James Edward Kinney, JR. , Dougal Stuart Ballantyne , Nishant Mehta
Abstract: Methods, systems, and computer-readable media for job scheduling based on job execution history are disclosed. A request is received to schedule a workload comprising a plurality of jobs. A resource allocation score for the workload is determined. The resource allocation score represents (at least in part) an estimated likelihood of successful execution of the workload. A first portion of the workload is scheduled for execution, and a remaining portion (if any) of the workload is delayed. A quantity of jobs in the first portion of the workload is determined based (at least in part) on the resource allocation score. Execution of the first portion of the workload is initiated.
-
公开(公告)号:US20240220461A1
公开(公告)日:2024-07-04
申请号:US18518176
申请日:2023-11-22
Applicant: Amazon Technologies, Inc.
Inventor: James Edward Kinney, JR. , Khawaja Salman Shams
IPC: G06F16/18
CPC classification number: G06F16/1873
Abstract: A journaling file system may implement remote durable logging. Updates to a file system may be received, and log records describing the updates may be stored in a locally-accessible file system change log. The update may then be acknowledged as committed. The log records may then be sent to be stored in a network-based data store in a remote version of the file system change log. Once it may be determined that the log records are stored in the remote version, storage space for the log records in the local file system change log may be reclaimed. Various types of restoration and duplication techniques may be implemented based on the remote version of the change log to restore a file system at an originating device or to duplicate the file system at a different device.
-
公开(公告)号:US20190272260A1
公开(公告)日:2019-09-05
申请号:US16415944
申请日:2019-05-17
Applicant: Amazon Technologies, Inc.
Inventor: James Edward Kinney, JR. , Khawaja Salman Shams
IPC: G06F16/18
Abstract: A journaling file system may implement remote durable logging. Updates to a file system may be received, and log records describing the updates may be stored in a locally-accessible file system change log. The update may then be acknowledged as committed. The log records may then be sent to be stored in a network-based data store in a remote version of the file system change log. Once it may be determined that the log records are stored in the remote version, storage space for the log records in the local file system change log may be reclaimed. Various types of restoration and duplication techniques may be implemented based on the remote version of the change log to restore a file system at an originating device or to duplicate the file system at a different device.
-
-
-
-