Data Deduplication Method and Apparatus
    1.
    发明申请

    公开(公告)号:US20200150890A1

    公开(公告)日:2020-05-14

    申请号:US16738401

    申请日:2020-01-09

    Abstract: A data deduplication method includes receiving an overwrite request sent by an external device, where the overwrite request carries a data block and a first address into which the data block is to be stored, determining whether an overwrite quantity of the first address exceeds a first threshold within a time period [t1, t2], where both t1 and t2 are time points, and t2 is later than t1, and when the overwrite quantity of the first address exceeds the first threshold within the time period [t1, t2], skipping performing a deduplication operation on the data block or when the overwrite quantity of the first address does not exceed the first threshold within the time period [t1, t2], performing a deduplication operation on the data block.

    Data deduplication method and apparatus

    公开(公告)号:US10564880B2

    公开(公告)日:2020-02-18

    申请号:US15403318

    申请日:2017-01-11

    Abstract: A data deduplication method and apparatus are provided. The method includes receiving an overwrite request sent by an external device, where the overwrite request carries a data block and a first address into which the data block is to be stored; determining whether an overwrite quantity of the first address exceeds a first threshold within a time period [t1, t2], where both t1 and t2 are time points, and t2 is later than t1; and when the overwrite quantity of the first address exceeds the first threshold within the time period [t1, t2], skipping performing a deduplication operation on the data block; or when the overwrite quantity of the first address does not exceed the first threshold within the time period [t1, t2], performing a deduplication operation on the data block. Therefore, a large quantity of computing resources of a storage server are saved, and impact brought by a deduplication operation on storage server performance is also decreased.

    Method and apparatus for data backup in storage system

    公开(公告)号:US10176058B2

    公开(公告)日:2019-01-08

    申请号:US15909613

    申请日:2018-03-01

    Abstract: Embodiments of the present disclosure disclose a solution for data backup and recovery in a storage system. When a source device in the storage system backs up, to a backup-end device, a data block that is written after a snapshot Sn, the source device performs a logical operation such as an exclusive-NOR or exclusive-OR operation on the written data block and an original data block, which is recorded in the snapshot Sn, of the written data block, and then compresses a data block obtained after the logical operation, which improves a compression ratio of a data block, thereby reducing an amount of data that is sent to the backup-end device, and saving transmission bandwidth. The solution may be further applied to a scenario of data recovery in a storage system.

    Data Deduplication Method and Apparatus
    4.
    发明申请

    公开(公告)号:US20170123712A1

    公开(公告)日:2017-05-04

    申请号:US15403318

    申请日:2017-01-11

    Abstract: A data deduplication method and apparatus are provided. The method includes receiving an overwrite request sent by an external device, where the overwrite request carries a data block and a first address into which the data block is to be stored; determining whether an overwrite quantity of the first address exceeds a first threshold within a time period [t1, t2], where both t1 and t2 are time points, and t2 is later than t1; and when the overwrite quantity of the first address exceeds the first threshold within the time period [t1, t2], skipping performing a deduplication operation on the data block; or when the overwrite quantity of the first address does not exceed the first threshold within the time period [t1, t2], performing a deduplication operation on the data block. Therefore, a large quantity of computing resources of a storage server are saved, and impact brought by a deduplication operation on storage server performance is also decreased.

    Data processing method and apparatus
    5.
    发明申请
    Data processing method and apparatus 审中-公开
    数据处理方法和装置

    公开(公告)号:US20140258625A1

    公开(公告)日:2014-09-11

    申请号:US14120286

    申请日:2014-05-14

    Abstract: Embodiments of the present invention provide a data processing method and apparatus. According to the embodiments of the present invention, when it is found that a data hash value in a currently received data stream exceeds a preset first threshold, a part or all of data in the data stream is not deduplicated, and is directly stored, so as to prevent the data in the data stream from being dispersedly stored into a plurality of storage areas; instead, the part or all of the data is stored into a storage area in a centralized manner, so that a deduplication rate is effectively improved on the whole, particularly in a scenario of large data storage amount.

    Abstract translation: 本发明的实施例提供一种数据处理方法和装置。 根据本发明的实施例,当发现当前接收的数据流中的数据散列值超过预设的第一阈值时,数据流中的部分或全部数据不被重复数据删除,并被直接存储,所以 以防止数据流中的数据被分散地存储到多个存储区域中; 相反,部分或全部数据以集中的方式存储在存储区域中,从而整体上有效地提高了重复数据删除率,特别是在大数据存储量的情况下。

    Data deduplication method and apparatus

    公开(公告)号:US11531482B2

    公开(公告)日:2022-12-20

    申请号:US16738401

    申请日:2020-01-09

    Abstract: A data deduplication method includes receiving an overwrite request sent by an external device, where the overwrite request carries a data block and a first address into which the data block is to be stored, determining whether an overwrite quantity of the first address exceeds a first threshold within a time period [t1, t2], where both t1 and t2 are time points, and t2 is later than t1, and when the overwrite quantity of the first address exceeds the first threshold within the time period [t1, t2], skipping performing a deduplication operation on the data block or when the overwrite quantity of the first address does not exceed the first threshold within the time period [t1, t2], performing a deduplication operation on the data block.

    Method and apparatus for data backup in storage system

    公开(公告)号:US10540240B2

    公开(公告)日:2020-01-21

    申请号:US16212219

    申请日:2018-12-06

    Abstract: Embodiments of the present disclosure disclose a solution for data backup and recovery in a storage system. When a source device in the storage system backs up, to a backup-end device, a data block that is written after a snapshot Sn, the source device performs a logical operation such as an exclusive-NOR or exclusive-OR operation on the written data block and an original data block, which is recorded in the snapshot Sn, of the written data block, and then compresses a data block obtained after the logical operation, which improves a compression ratio of a data block, thereby reducing an amount of data that is sent to the backup-end device, and saving transmission bandwidth. The solution may be further applied to a scenario of data recovery in a storage system.

    Data processing method and apparatus

    公开(公告)号:US08760956B1

    公开(公告)日:2014-06-24

    申请号:US14140945

    申请日:2013-12-26

    Abstract: Embodiments of the present invention provide a data processing method and apparatus. According to the embodiments of the present invention, when it is found that a data hash value in a currently received data stream exceeds a preset first threshold, a part or all of data in the data stream is not deduplicated, and is directly stored, so as to prevent the data in the data stream from being dispersedly stored into a plurality of storage areas; instead, the part or all of the data is stored into a storage area in a centralized manner, so that a deduplication rate is effectively improved on the whole, particularly in a scenario of large data storage amount.

Patent Agency Ranking