公开(公告)号：US08812752B1

公开(公告)日：2014-08-19

申请号：US13764711

申请日：2013-02-11

Applicant: Amazon Technologies, Inc.

Inventor： Kathryn Marie Shih ,  Eider Brantly Moore ,  Richard Rex McKnight ,  Vaibhav Aggarwal ,  Peter Sirota ,  Richard Jeffrey Cole ,  James P. Bartlett ,  Carl Louis Christofferson

IPC: G06F3/00 ,  G06F9/44

CPC classification number: G06F9/52 ,  G06F9/542 ,  G06Q10/063

Abstract: Methods and systems for a connector interface in a data pipeline are disclosed. A pipeline comprising two data source nodes and an activity node is configured. Each data source node represents data from a different data source, and the activity node represents a workflow activity that uses the data as input. Two connectors which implement the same connector interface are triggered. In response, data is acquired at each connector from the corresponding data source through the connector interface. The data is sent from the connectors to the activity node through the connector interface. The workflow activity is performed using the acquired data.

Abstract translation: 公开了数据管线中的连接器接口的方法和系统。 配置包括两个数据源节点和活动节点的流水线。 每个数据源节点表示来自不同数据源的数据，活动节点表示使用数据作为输入的工作流活动。 实现相同连接器接口的两个连接器被触发。 作为响应，通过连接器接口从相应的数据源在每个连接器处获取数据。 数据通过连接器接口从连接器发送到活动节点。 使用获取的数据执行工作流活动。

公开(公告)号：US09588822B1

公开(公告)日：2017-03-07

申请号：US13764716

申请日：2013-02-11

Applicant: Amazon Technologies, Inc.

Inventor： Kathryn Marie Shih ,  Eider Brantly Moore ,  Lorenzo Minore ,  Carl Louis Christofferson ,  Richard Rex McKnight ,  Richard Jeffrey Cole ,  Vaibhav Aggarwal ,  Peter Sirota ,  James P. Bartlett

IPC: G06F9/46 ,  G06F9/52

CPC classification number: G06F9/52 ,  G06F9/542 ,  G06Q10/063

Abstract: Methods and systems for using a scheduler in a data pipeline are disclosed. A plurality of objects in a first layer are created, each representing a respective regularly scheduled task. A plurality of objects in a second layer are created, each representing a respective scheduled instance of a regularly scheduled task. It is determined whether each object in the second layer is ready to execute. For at least one object in the second layer, it is determined if the object has received notifications from any objects on which it depends. For each object that is ready to execute, the regularly scheduled task associated with the object is performed. For each object that is not ready to execute, the object is put to sleep.

Abstract translation: 公开了在数据流水线中使用调度器的方法和系统。 创建第一层中的多个对象，每个对象表示相应的规则排列任务。 创建第二层中的多个对象，每个对象表示规则调度任务的相应调度实例。 确定第二层中的每个对象是否准备好执行。 对于第二层中的至少一个对象，确定对象是否已经从其所依赖的任何对象接收到通知。 对于准备执行的每个对象，执行与对象相关联的定期计划的任务。 对于尚未准备好执行的每个对象，对象都将进入休眠状态。