发明申请
- 专利标题: Generating Filters Automatically From Data Processing Jobs
- 专利标题(中): 从数据处理作业自动生成过滤器
-
申请号: US13324202申请日: 2011-12-13
-
公开(公告)号: US20130152088A1公开(公告)日: 2013-06-13
- 发明人: Christos Gkantsidis , Dimitrios Vytiniotis , Orion Hodson , Dushyanth Narayanan , Antony Rowstron
- 申请人: Christos Gkantsidis , Dimitrios Vytiniotis , Orion Hodson , Dushyanth Narayanan , Antony Rowstron
- 申请人地址: US WA Redmond
- 专利权人: Microsoft Corporation
- 当前专利权人: Microsoft Corporation
- 当前专利权人地址: US WA Redmond
- 主分类号: G06F9/46
- IPC分类号: G06F9/46 ; G06F17/30
摘要:
Methods of generating filters automatically from data processing jobs are described. In an embodiment, these filters are automatically generated from a compiled version of the data processing job using static analysis which is applied to a high-level representation of the job. The executable filter is arranged to suppress rows and/or columns within the data to which the job is applied and which do not affect the output of the job. The filters are generated by a filter generator and then stored and applied dynamically at a filtering proxy that may be co-located with the storage node that holds the data. In another embodiment, the filtered data may be cached close to a compute node which runs the job and data may be provided to the compute node from the local cache rather than from the filtering proxy.
公开/授权文献
信息查询