Shuffle embedded distributed storage system supporting virtual merge and method thereof

    公开(公告)号:US10135926B2

    公开(公告)日:2018-11-20

    申请号:US14919135

    申请日:2015-10-21

    Abstract: Provided herein is a shuffle embedded distributed storage system and method supporting virtual merge, the system and method including a distributed shared storage configured to store a virtual merged file; a plurality of map servers connected to the distributed shared storage via a network, and configured to perform a map function and record a map result data computed as a result of the map function in the distributed shared storage by means of a map result file; and a plurality of reduce servers connected to the distributed shared storage and the map servers via the network, wherein the virtual merged file includes a list of the map result files recorded by the plurality of map servers, and an identifier of a reduce server to which the virtual merged file is to be transmitted.

Patent Agency Ranking