-
公开(公告)号:US20200311054A1
公开(公告)日:2020-10-01
申请号:US16368723
申请日:2019-03-28
Applicant: Amazon Technologies, Inc.
Abstract: Technology is described for computationally intensive distributed computing systems and methods. A storage process for representing data objects in memory using a serialization format that provides low replication cost and thread-safe reads may include receiving a data object by a computing hub. A distributed shared memory of the computing hub may write the data object to a memory device associated with the computing hub using a byte array broken into a plurality of sections. The plurality of sections may describe the in-memory content of the data object and include information on how to read the plurality of sections to obtain a current state of the data object. The distributed shared memory may process requests from processing applications to modify data associated with the data object. The distributed shared memory may write mutations to the data object caused by the requests to the memory device using an ordered, log-based format to provide versioned snapshots of state.
-
公开(公告)号:US20200310882A1
公开(公告)日:2020-10-01
申请号:US16368697
申请日:2019-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Denis Scalabrini , Adam Julio Villalobos
IPC: G06F9/50
Abstract: Technology is described for computationally intensive distributed computing systems and methods. A method for using object types to distribute processing may include determining object types for data objects. A mapping between the data objects and processing partitions may be determined using the object types. A processing partition may be associated with a processing application that processes data objects of a given object type. A hardware host in a distributed computing system may be identified to process the data objects of the given object type, which are mapped to the processing partition. The processing partition may be sent to the hardware host to process the data objects, and the hardware host may include an instance of the processing application to process the data objects in the processing partition.
-
公开(公告)号:US11436217B2
公开(公告)日:2022-09-06
申请号:US16368723
申请日:2019-03-28
Applicant: Amazon Technologies, Inc.
Abstract: Technology is described for computationally intensive distributed computing systems and methods. A storage process for representing data objects in memory using a serialization format that provides low replication cost and thread-safe reads may include receiving a data object by a computing hub. A distributed shared memory of the computing hub may write the data object to a memory device associated with the computing hub using a byte array broken into a plurality of sections. The plurality of sections may describe the in-memory content of the data object and include information on how to read the plurality of sections to obtain a current state of the data object. The distributed shared memory may process requests from processing applications to modify data associated with the data object. The distributed shared memory may write mutations to the data object caused by the requests to the memory device using an ordered, log-based format to provide versioned snapshots of state.
-
公开(公告)号:US10664385B1
公开(公告)日:2020-05-26
申请号:US15405669
申请日:2017-01-13
Applicant: Amazon Technologies, Inc.
Inventor: Adam Julio Villalobos , Martin Paul Zolnieryk , Andrew Kyle McWilliams , Brian James Schuster
Abstract: Techniques for debugging of a collection of instructions executed by a computing system including a set of actors are described herein. A first sub-set of actors from the set of actors to be monitored for debugging and one or more error condition associated with the collection of instructions may be identified. A set of indications including indications of messages processed by the actors, indications of associated actor states prior to processing of the messages, and indications of associated actor states subsequent to processing of the messages may be received from the sub-set of actors. It may then be determined that a first actor of the sub-set of actors has satisfied the error condition. Based at least in part on the set of indications, one or more messages associated with satisfaction of the error condition may then be identified, for example for re-processing and debugging.
-
公开(公告)号:US10146877B1
公开(公告)日:2018-12-04
申请号:US14827882
申请日:2015-08-17
Applicant: Amazon Technologies, Inc.
Inventor: Martin Paul Zolnieryk , Adam Julio Villalobos , Alexander Neil Stajos
IPC: G06F17/30 , G06F3/0487
Abstract: Techniques for area of interest subscription are described herein. In some examples, a requestor, such as a client or other component, may be focused on a particular area of interest within a virtual space. A requestor may, for example, provide information indicating its area of interest within the virtual space. This information may then be used to determine one or more sub-spaces that are at least partially included within the area of interest. The requestor may then be subscribed to each sub-space that is at least partially included within the area of interest. When subscribed to a sub-space, object registration information indicating one or more objects that are registered to the sub-space may be received from one or more sub-space components that are associated with the sub-space.
-
公开(公告)号:US11150960B2
公开(公告)日:2021-10-19
申请号:US16368738
申请日:2019-03-28
Applicant: Amazon Technologies, Inc.
IPC: G06F9/50 , G06F9/38 , G06F16/23 , G06F16/909 , G06F16/9035
Abstract: Technology is described for computationally intensive distributed computing systems and methods. A method for using object types to distribute processing may include determining object types for data objects. A mapping between the data objects and processing partitions may be determined using the object types. A processing partition may be associated with a processing application that processes data objects of a given object type. A hardware host in a distributed computing system may identify an application library having a plurality of processing applications that process a plurality of data objects associated with a plurality of object types. The hardware host may use the processing partition assigned to the hardware host to identify the processing application for the object type associated with the processing partition from the application library. The hardware host may launch an instance of the processing application to enable the hardware host to process the plurality of data objects.
-
公开(公告)号:US11106502B2
公开(公告)日:2021-08-31
申请号:US16368697
申请日:2019-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Denis Scalabrini , Adam Julio Villalobos
IPC: G06F9/50
Abstract: Technology is described for computationally intensive distributed computing systems and methods. A method for using object types to distribute processing may include determining object types for data objects. A mapping between the data objects and processing partitions may be determined using the object types. A processing partition may be associated with a processing application that processes data objects of a given object type. A hardware host in a distributed computing system may be identified to process the data objects of the given object type, which are mapped to the processing partition. The processing partition may be sent to the hardware host to process the data objects, and the hardware host may include an instance of the processing application to process the data objects in the processing partition.
-
公开(公告)号:US20200311142A1
公开(公告)日:2020-10-01
申请号:US16368677
申请日:2019-03-28
Applicant: Amazon Technologies, Inc.
IPC: G06F16/901 , G06F16/27
Abstract: Technology is described for using spatial analysis of data objects associated with a multi-dimensional virtual environment to organize computational units in a distributed computing system. The data objects may be grouped together using spatial location information and collections of data objects may be treated as processing partitions (i.e., sub-divisions of the entire group of data objects). A mapping may be created between the data objects and processing partitions for processing applications which process data objects assigned to a processing partition. The processing partitions may be defined, in part, according to how the data objects are grouped together spatially. The processing partitions may be load-balanced across hardware hosts in the distributed computing system.
-
公开(公告)号:US09569339B1
公开(公告)日:2017-02-14
申请号:US14807365
申请日:2015-07-23
Applicant: Amazon Technologies, Inc.
Inventor: Adam Julio Villalobos , Martin Paul Zolnieryk , Andrew Kyle McWilliams , Brian James Schuster
CPC classification number: G06F11/3644 , G06F11/3466 , G06F11/3636 , G06F11/3648 , G06F11/3664 , G06F11/3688
Abstract: Techniques for debugging of a collection of instructions executed by a computing system including a set of actors are described herein. A first sub-set of actors from the set of actors to be monitored for debugging and one or more error condition associated with the collection of instructions may be identified. A set of indications including indications of messages processed by the actors, indications of associated actor states prior to processing of the messages, and indications of associated actor states subsequent to processing of the messages may be received from the sub-set of actors. It may then be determined that a first actor of the sub-set of actors has satisfied the error condition. Based at least in part on the set of indications, one or more messages associated with satisfaction of the error condition may then be identified, for example for re-processing and debugging.
Abstract translation: 这里描述了用于调试由包括一组演员的计算系统执行的指令集合的技术。 可以识别来自被监视的用于调试的一组参与者的第一子集,以及与指令集合相关联的一个或多个错误状况。 可以从演员的子组中接收包括演员处理的消息的指示,消息处理之前的相关联的演员状态的指示以及处理消息之后的相关联的演员状态的指示的集合。 然后可以确定演员子集的第一演员已经满足了错误状况。 至少部分地基于一组指示,然后可以识别与满足错误状况相关联的一个或多个消息,例如用于重新处理和调试。
-
公开(公告)号:US20250005473A1
公开(公告)日:2025-01-02
申请号:US18346050
申请日:2023-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Denis Scalabrini , Adam Julio Villalobos
IPC: G06Q10/0631
Abstract: Automated scaling-related operations may be performed dynamically during execution of a spatial simulation. A spatial partition may be locally reassigned, based on application workload information, from a first application to a second application on the same worker. A quantity of applications on a worker may also be changed during execution of a spatial simulation. A parent spatial partition may be split into child spatial partitions, and child partitions may also be merged back into a common parent partition. Indications of partition splits and merges on each of a plurality of workers may be reported to the plurality of workers. A spatial partition may also be remotely reassigned from a first worker to a second worker, such as based on worker-level resource consumption information and partition information. A quantity of workers that are used to implement a spatial simulation may also be changed during execution of the spatial simulation.
-
-
-
-
-
-
-
-
-