- 专利标题: RDMA transfers in mapreduce frameworks
-
申请号: US14559266申请日: 2014-12-03
-
公开(公告)号: US09923726B2公开(公告)日: 2018-03-20
- 发明人: Muhammad Sohaib Aslam , Tiia J. Salo
- 申请人: International Business Machines Corporation
- 申请人地址: US NY Armonk
- 专利权人: International Business Machines Corporation
- 当前专利权人: International Business Machines Corporation
- 当前专利权人地址: US NY Armonk
- 代理商 Alexander G. Jochym; Noah A. Sharkan
- 主分类号: G06F15/16
- IPC分类号: G06F15/16 ; H04L12/06 ; G06F9/50
摘要:
Embodiments of the present invention provide methods, systems, and computer program products for transferring data in a MapReduce framework. In one embodiment, MapReduce jobs are performed such that data spills are stored by mapper systems in memory and are transferred to reducer systems via one-sided RDMA transfers, which can reduce CPU overhead of mapper systems and the latency of data transfer to reducer systems.
公开/授权文献
- US20160162437A1 RDMA TRANSFERS IN MAPREDUCE FRAMEWORKS 公开/授权日:2016-06-09
信息查询