Multi-streamed method for optimizing data transfer through parallelized interlacing of data based upon sorted characteristics to minimize latencies inherent in the system
    1.
    发明申请
    Multi-streamed method for optimizing data transfer through parallelized interlacing of data based upon sorted characteristics to minimize latencies inherent in the system 有权
    用于通过基于分类特征的数据的并行隔行来优化数据传输的多流方法,以最小化系统固有的延迟

    公开(公告)号:US20110004601A1

    公开(公告)日:2011-01-06

    申请号:US12497564

    申请日:2009-07-03

    IPC分类号: G06F17/30 G06F12/00

    CPC分类号: G06F11/1453 G06F11/1464

    摘要: A method for optimizing data transfer through parallelized interlacing of data based upon sorted characteristics to minimize latencies inherent in the system. Operating a plurality of threads in parallel on disparate file sizes ordered by an additional thread. Efficient backup of heterogeneous non-volatile mass store to a network attached server. Scalable distribution of backup processes for computing hashes and eliminating duplication. Increased granularity of file pieces to match blocking of file I/O with network transmission. Efficiently packing each network transmission block using sequence search criteria. Avoidance of sending undesired pieces. Segmentation of each file and object into a hierarchy of pieces in a plurality of types.

    摘要翻译: 一种通过基于分类特征的数据并行交错优化数据传输的方法,以最小化系统固有的延迟。 在由额外线程排序的不同文件大小上并行操作多个线程。 异构非易失性大容量存储的高效备份到网络连接的服务器。 用于计算散列的备份过程的可扩展分布和消除重复。 增加文件碎片的粒度以匹配文件I / O与网络传输的阻塞。 使用序列搜索条件有效地打包每个网络传输块。 避免发送不需要的部分。 将每个文件和对象分割成多个类型的片段的层次结构。