公开(公告)号：US12026532B2

公开(公告)日：2024-07-02

申请号：US18229450

申请日：2023-08-02

Applicant: Google LLC

Inventor： Craig D. Chambers ,  Ashish Raniwala ,  Frances J. Perry ,  Stephen R. Adams ,  Robert R. Henry ,  Robert Bradshaw ,  Nathan Weizenbaum

IPC: G06F9/46 ,  G06F8/30 ,  G06F8/34 ,  G06F8/41 ,  G06F9/38 ,  G06F9/44 ,  G06F9/445 ,  G06F9/455 ,  G06F9/48 ,  G06F16/25 ,  G06F21/57 ,  G06F21/62 ,  G06F9/30 ,  G06F9/448 ,  G06F16/2453

CPC classification number: G06F9/45504 ,  G06F8/314 ,  G06F8/34 ,  G06F8/433 ,  G06F9/38 ,  G06F9/3851 ,  G06F9/3885 ,  G06F9/44 ,  G06F9/445 ,  G06F9/45533 ,  G06F9/4843 ,  G06F21/577 ,  G06F21/62 ,  G06F21/6218 ,  G06F9/30 ,  G06F9/4494 ,  G06F16/24532 ,  G06F16/24547 ,  G06F2221/034

Abstract: A data parallel pipeline may specify multiple parallel data objects that contain multiple elements and multiple parallel operations that operate on the parallel data objects. Based on the data parallel pipeline, a dataflow graph of deferred parallel data objects and deferred parallel operations corresponding to the data parallel pipeline may be generated and one or more graph transformations may be applied to the dataflow graph to generate a revised dataflow graph that includes one or more of the deferred parallel data objects and deferred, combined parallel data operations. The deferred, combined parallel operations may be executed to produce materialized parallel data objects corresponding to the deferred parallel data objects.

公开(公告)号：US20230376332A1

公开(公告)日：2023-11-23

申请号：US18229450

申请日：2023-08-02

Applicant: Google LLC

Inventor： Craig D. Chambers ,  Ashish Raniwala ,  Frances J. Perry ,  Stephen R. Adams ,  Robert R. Henry ,  Robert Bradshaw ,  Nathan Weizenbaum

IPC: G06F9/455 ,  G06F21/62 ,  G06F9/38 ,  G06F8/41 ,  G06F9/48 ,  G06F8/30 ,  G06F8/34 ,  G06F9/44 ,  G06F9/445 ,  G06F21/57

CPC classification number: G06F9/45504 ,  G06F21/62 ,  G06F9/38 ,  G06F9/3851 ,  G06F9/3885 ,  G06F8/433 ,  G06F9/4843 ,  G06F8/314 ,  G06F8/34 ,  G06F9/44 ,  G06F9/45533 ,  G06F9/445 ,  G06F21/577 ,  G06F21/6218 ,  G06F16/24532

Abstract: A data parallel pipeline may specify multiple parallel data objects that contain multiple elements and multiple parallel operations that operate on the parallel data objects. Based on the data parallel pipeline, a dataflow graph of deferred parallel data objects and deferred parallel operations corresponding to the data parallel pipeline may be generated and one or more graph transformations may be applied to the dataflow graph to generate a revised dataflow graph that includes one or more of the deferred parallel data objects and deferred, combined parallel data operations. The deferred, combined parallel operations may be executed to produce materialized parallel data objects corresponding to the deferred parallel data objects.

公开(公告)号：US10025620B2

公开(公告)日：2018-07-17

申请号：US14989867

申请日：2016-01-07

Applicant: Google LLC

Inventor： Robert Bradshaw ,  Craig D. Chambers ,  Ezra Cooper ,  Ashish Raniwala ,  Frances J. Perry

IPC: G06F9/455 ,  G06F9/45 ,  G06F17/30 ,  G06F9/46 ,  G06F9/38 ,  G06F8/41 ,  G06F9/50 ,  G06F11/30

Abstract: One example method includes identifying synchronous code including instructions specifying a computing operation to be performed on a set of data; transforming the synchronous code into a pipeline application including one or more pipeline objects; identifying a first input data set on which to execute the pipeline application; executing the pipeline application on a first input data set to produce a first output data set; after executing the pipeline application on the first input data set, identifying a second input data set on which to execute the pipeline application; determining a set of differences between the first input data set and second input data set; and executing the pipeline application on the set of differences to produce a second output data set.

公开(公告)号：US20180314545A1

公开(公告)日：2018-11-01

申请号：US16030183

申请日：2018-07-09

Applicant: Google LLC

Inventor： Robert Bradshaw ,  Craig D. Chambers ,  Ezra Cooper ,  Ashish Raniwala ,  Frances J. Perry

IPC: G06F9/46 ,  G06F9/50 ,  G06F8/41 ,  G06F9/38 ,  G06F9/455

CPC classification number: G06F9/466 ,  G06F8/453 ,  G06F9/3867 ,  G06F9/3885 ,  G06F9/455 ,  G06F9/5066 ,  G06F11/3006 ,  G06F17/30463 ,  G06F17/30569

Abstract: One example method includes identifying synchronous code including instructions specifying a computing operation to be performed on a set of data; transforming the synchronous code into a pipeline application including one or more pipeline objects; identifying a first input data set on which to execute the pipeline application; executing the pipeline application on a first input data set to produce a first output data set; after executing the pipeline application on the first input data set, identifying a second input data set on which to execute the pipeline application; determining a set of differences between the first input data set and second input data set; and executing the pipeline application on the set of differences to produce a second output data set.

公开(公告)号：US20240338235A1

公开(公告)日：2024-10-10

申请号：US18748889

申请日：2024-06-20

Applicant: Google LLC

Inventor： Craig D. Chambers ,  Ashish Raniwala ,  Frances J. Perry ,  Stephen R. Adams ,  Robert R. Henry ,  Robert Bradshaw ,  Nathan Weizenbaum

IPC: G06F9/455 ,  G06F8/30 ,  G06F8/34 ,  G06F8/41 ,  G06F9/30 ,  G06F9/38 ,  G06F9/44 ,  G06F9/445 ,  G06F9/448 ,  G06F9/48 ,  G06F16/2453 ,  G06F21/57 ,  G06F21/62

CPC classification number: G06F9/45504 ,  G06F8/314 ,  G06F8/34 ,  G06F8/433 ,  G06F9/38 ,  G06F9/3851 ,  G06F9/3885 ,  G06F9/44 ,  G06F9/445 ,  G06F9/45533 ,  G06F9/4843 ,  G06F21/577 ,  G06F21/62 ,  G06F21/6218 ,  G06F9/30 ,  G06F9/4494 ,  G06F16/24532 ,  G06F16/24547 ,  G06F2221/034

Abstract: A data parallel pipeline may specify multiple parallel data objects that contain multiple elements and multiple parallel operations that operate on the parallel data objects. Based on the data parallel pipeline, a dataflow graph of deferred parallel data objects and deferred parallel operations corresponding to the data parallel pipeline may be generated and one or more graph transformations may be applied to the dataflow graph to generate a revised dataflow graph that includes one or more of the deferred parallel data objects and deferred, combined parallel data operations. The deferred, combined parallel operations may be executed to produce materialized parallel data objects corresponding to the deferred parallel data objects.

公开(公告)号：US10133592B2

公开(公告)日：2018-11-20

申请号：US15483044

申请日：2017-04-10

Applicant: Google LLC

Inventor： Craig D. Chambers ,  Ashish Raniwala ,  Frances J. Perry ,  Stephen R. Adams ,  Robert R. Henry ,  Robert Bradshaw ,  Nathan Weizenbaum

IPC: G06F9/44 ,  G06F9/45 ,  G06F17/30 ,  G06F9/455 ,  G06F21/62 ,  G06F9/38 ,  G06F8/41 ,  G06F9/48 ,  G06F8/30 ,  G06F8/34 ,  G06F9/445 ,  G06F21/57 ,  G06F9/30 ,  G06F9/448

Abstract: A data parallel pipeline may specify multiple parallel data objects that contain multiple elements and multiple parallel operations that operate on the parallel data objects. Based on the data parallel pipeline, a dataflow graph of deferred parallel data objects and deferred parallel operations corresponding to the data parallel pipeline may be generated and one or more graph transformations may be applied to the dataflow graph to generate a revised dataflow graph that includes one or more of the deferred parallel data objects and deferred, combined parallel data operations. The deferred, combined parallel operations may be executed to produce materialized parallel data objects corresponding to the deferred parallel data objects.

公开(公告)号：US11755351B2

公开(公告)日：2023-09-12

申请号：US17834256

申请日：2022-06-07

Applicant: Google LLC

Inventor： Craig D. Chambers ,  Ashish Raniwala ,  Frances J. Perry ,  Stephen R. Adams ,  Robert R. Henry ,  Robert Bradshaw ,  Nathan Weizenbaum

IPC: G06F9/38 ,  G06F16/2453 ,  G06F21/57 ,  G06F9/445 ,  G06F9/455 ,  G06F21/62 ,  G06F8/41 ,  G06F9/48 ,  G06F8/30 ,  G06F8/34 ,  G06F9/44 ,  G06F9/448 ,  G06F9/30

CPC classification number: G06F9/45504 ,  G06F8/314 ,  G06F8/34 ,  G06F8/433 ,  G06F9/38 ,  G06F9/3851 ,  G06F9/3885 ,  G06F9/44 ,  G06F9/445 ,  G06F9/45533 ,  G06F9/4843 ,  G06F21/577 ,  G06F21/62 ,  G06F21/6218 ,  G06F9/30 ,  G06F9/4494 ,  G06F16/24532 ,  G06F16/24547 ,  G06F2221/034

Abstract: A data parallel pipeline may specify multiple parallel data objects that contain multiple elements and multiple parallel operations that operate on the parallel data objects. Based on the data parallel pipeline, a dataflow graph of deferred parallel data objects and deferred parallel operations corresponding to the data parallel pipeline may be generated and one or more graph transformations may be applied to the dataflow graph to generate a revised dataflow graph that includes one or more of the deferred parallel data objects and deferred, combined parallel data operations. The deferred, combined parallel operations may be executed to produce materialized parallel data objects corresponding to the deferred parallel data objects.

公开(公告)号：US20220300310A1

公开(公告)日：2022-09-22

申请号：US17834256

申请日：2022-06-07

Applicant: Google LLC

Inventor： Craig D. Chambers ,  Ashish Raniwala ,  Frances J. Perry ,  Stephen R. Adams ,  Robert R. Henry ,  Robert Bradshaw ,  Nathan Weizenbaum

IPC: G06F9/455 ,  G06F21/62 ,  G06F9/38 ,  G06F8/41 ,  G06F9/48 ,  G06F8/30 ,  G06F8/34 ,  G06F9/44 ,  G06F9/445 ,  G06F21/57

Abstract: A data parallel pipeline may specify multiple parallel data objects that contain multiple elements and multiple parallel operations that operate on the parallel data objects. Based on the data parallel pipeline, a dataflow graph of deferred parallel data objects and deferred parallel operations corresponding to the data parallel pipeline may be generated and one or more graph transformations may be applied to the dataflow graph to generate a revised dataflow graph that includes one or more of the deferred parallel data objects and deferred, combined parallel data operations. The deferred, combined parallel operations may be executed to produce materialized parallel data objects corresponding to the deferred parallel data objects.

公开(公告)号：US10795705B2

公开(公告)日：2020-10-06

申请号：US16449987

申请日：2019-06-24

Applicant: Google LLC

Inventor： Craig D. Chambers ,  Ashish Raniwala ,  Frances J. Perry ,  Stephen R. Adams ,  Robert R. Henry ,  Robert Bradshaw ,  Nathan Weizenbaum

IPC: G06F9/44 ,  G06F9/46 ,  G06F9/48 ,  G06F9/50 ,  H04L29/08 ,  G06F9/455 ,  G06F21/62 ,  G06F9/38 ,  G06F8/41 ,  G06F8/30 ,  G06F8/34 ,  G06F9/445 ,  G06F21/57 ,  G06F16/2453 ,  G06F9/448 ,  G06F9/30

Abstract: A data parallel pipeline may specify multiple parallel data objects that contain multiple elements and multiple parallel operations that operate on the parallel data objects. Based on the data parallel pipeline, a dataflow graph of deferred parallel data objects and deferred parallel operations corresponding to the data parallel pipeline may be generated and one or more graph transformations may be applied to the dataflow graph to generate a revised dataflow graph that includes one or more of the deferred parallel data objects and deferred, combined parallel data operations. The deferred, combined parallel operations may be executed to produce materialized parallel data objects corresponding to the deferred parallel data objects.

公开(公告)号：US20190317782A1

公开(公告)日：2019-10-17

申请号：US16449987

申请日：2019-06-24

Applicant: Google LLC

Inventor： Craig D. Chambers ,  Ashish Raniwala ,  Frances J. Perry ,  Stephen R. Adams ,  Robert R. Henry ,  Robert Bradshaw ,  Nathan Weizenbaum

IPC: G06F9/455 ,  G06F9/38 ,  G06F8/30 ,  G06F8/34 ,  G06F9/44 ,  G06F21/62 ,  G06F8/41 ,  G06F9/48 ,  G06F21/57 ,  G06F9/445

Abstract: A data parallel pipeline may specify multiple parallel data objects that contain multiple elements and multiple parallel operations that operate on the parallel data objects. Based on the data parallel pipeline, a dataflow graph of deferred parallel data objects and deferred parallel operations corresponding to the data parallel pipeline may be generated and one or more graph transformations may be applied to the dataflow graph to generate a revised dataflow graph that includes one or more of the deferred parallel data objects and deferred, combined parallel data operations. The deferred, combined parallel operations may be executed to produce materialized parallel data objects corresponding to the deferred parallel data objects.