In-place resumable partial decompression

    公开(公告)号:US10444991B1

    公开(公告)日:2019-10-15

    申请号:US14964498

    申请日:2015-12-09

    Abstract: Processing and memory resources are optimized in a data storage system by reading a region of compressed data containing desired data is read from primary storage, writing the compressed data to a memory page, selectively decompressing the compressed data to retrieve the desired data, and the writing the decompressed data back to the same page. State information about the start of the compressed data and the end of the decompressed data on the page is maintained to enable decompression to be halted and resumed on demand.

    Method and system for container data recovery in a storage system

    公开(公告)号:US10019323B1

    公开(公告)日:2018-07-10

    申请号:US14225188

    申请日:2014-03-25

    CPC classification number: G06F11/1469 G06F11/1004 G06F11/1435 G06F16/184

    Abstract: A computer-implemented method is disclosed. The method starts with determining a first container of a storage system is invalid. The method continues with the storage system setting a data recovery state for the first container to be en-queue, which indicates that data of at least one of the data segments needs to be recovered from the first container, and executing a process to recover any container having an en-queue data recovery state, and for each of the containers, to recover any valid data segment from the corresponding container. The process includes scanning the data segments of the first container to find valid data segments, moving or replicating the valid data segments to a second container, and setting the data recovery state for the first container to be complete once all the valid data segments are moved or replicated to the second container.

    Multiple location index
    3.
    发明授权

    公开(公告)号:US10922228B1

    公开(公告)日:2021-02-16

    申请号:US14674911

    申请日:2015-03-31

    Abstract: Systems and methods for accessing data stored in multiple locations. A cache and a storage system are associated with an index. Entries in the index identify locations of data in both the cache and the storage system. When an index lookup occurs and an entry in the index identifies at least two locations for the data, the locations are ordered based on at least one factor and the data stored in the optimal location as determined from the at least one factor is returned.

    Method to optimize random IOS of a storage device for multiple versions of backups using incremental metadata

    公开(公告)号:US10055420B1

    公开(公告)日:2018-08-21

    申请号:US14788598

    申请日:2015-06-30

    Abstract: Methods, systems, and apparatus for optimizing a cache memory device of a storage system are described. In one embodiment, a first base segment tree representing a first full backup including data and metadata describing the data is cached in a cache memory device. Subsequently, a plurality of incremental segment trees representing incremental backups to the first full backup are cached in the cache memory device. Each of incremental segment trees corresponding to the changes to the first full backup, without modifying the first base segment tree in response to the changes. At least two of the incremental segment trees are merged into an updated incremental segment tree to reduce a storage space of the cache memory device to store the incremental segment trees. The updated incremental segment tree comprises data and metadata represented by two or more incremental segment trees.

    Online replacement of physical storage in a virtual storage system
    5.
    发明授权
    Online replacement of physical storage in a virtual storage system 有权
    在虚拟存储系统中在线更换物理存储

    公开(公告)号:US09250823B1

    公开(公告)日:2016-02-02

    申请号:US14282318

    申请日:2014-05-20

    Abstract: Physical storage is replaced online in a data integrity storage system comprising RAID groups of physical disks in separate enclosures (shelves). All disks of a RAID group are located on a corresponding shelf, and each shelf is mapped by an internal file system to a separate independent logical address space partitioned into a plurality of blocks forming a blockset containing data and metadata. Source shelf disk data is moved online to disks of a target shelf using invulnerable data movement that ensures the integrity of the data, and source shelf blockset metadata is migrated to a corresponding target shelf blockset. After verifying the correctness of the target data and metadata, the source shelf and blockset are removed.

    Abstract translation: 物理存储在数据完整性存储系统中在线替换,该系统包括分离的机箱(货架)中物理磁盘的RAID组。 RAID组的所有磁盘都位于相应的货架上,每个货架由一个内部文件系统映射到一个独立的独立逻辑地址空间,该独立的逻辑地址空间被划分成多个块,形成一个包含数据和元数据的块组。 使用无障碍数据移动将源机架磁盘数据在线移动到目标机架的磁盘,从而确保数据的完整性,并将源机箱块集元数据迁移到相应的目标机架块集。 在验证了目标数据和元数据的正确性之后,源架和块集被删除。

    Sparse segment trees for high metadata churn workloads

    公开(公告)号:US09996426B1

    公开(公告)日:2018-06-12

    申请号:US14788184

    申请日:2015-06-30

    Abstract: Methods, systems, and apparatus for providing data storage services of a storage system are described. In one embodiment, a first file representing a first full backup including data and metadata describing the data is cached as a first segment tree having a plurality of layers of nodes in a tree hierarchy. A second file representing an incremental backup of the first full backup is cached as a second segment tree in the cache memory device. The second segment tree describes changes of the data and the metadata of the incremental backup in view of the data and the metadata of the first full backup without caching any of nodes of the first segment tree again. The first and second segment trees are collectively used to represent a second full backup based on the incremental backup and the first full backup.

    Invulnerable data movement for file system upgrade
    8.
    发明授权
    Invulnerable data movement for file system upgrade 有权
    不受影响的文件系统升级数据移动

    公开(公告)号:US09256373B1

    公开(公告)日:2016-02-09

    申请号:US14281855

    申请日:2014-05-19

    Abstract: A single virtual storage device file system that abstracts multiple RAID groups of physical storage devices into one virtual device and one first blockset having a plurality of data blocks in a contiguous linear address space is converted into a multiple virtual device file system that abstracts the multiple RAID groups of physical storage devices as separate multiple virtual storage devices each having a separate second blockset and address space, by migrating data in allocated blocks at boundaries of the physical storage device groups to free blocks, partitioning the first blockset at the boundaries into the multiple second blocksets, updating the block metadata of each block, and rebuilding the file system using the block metadata to generate second blockset metadata.

    Abstract translation: 单个虚拟存储设备文件系统将物理存储设备的多个RAID组抽象成一个虚拟设备,并且在连续的线性地址空间中具有多个数据块的一个第一块集合被转换成多个虚拟设备文件系统,其抽取多个RAID 通过将物理存储设备组的边界处的分配块中的数据迁移到空闲块,将每个具有单独的第二块集合和地址空间的多个虚拟存储设备分组为多个虚拟存储设备,将边界处的第一块集分成多个秒 块组,更新每个块的块元数据,以及使用块元数据重建文件系统以生成第二块集元数据。

    Segment index access management in a de-duplication system

    公开(公告)号:US10216748B1

    公开(公告)日:2019-02-26

    申请号:US14871749

    申请日:2015-09-30

    Abstract: Techniques to perform segment index lookups are disclosed. In various embodiments, for each of one or more segment index entries included in a first on disk segment index a corresponding set of values is stored in a bloom filter. The bloom filter is used to determine prior to performing an on disk segment lookup of the segment index with respect to a given segment whether each location in the bloom filter that is associated with the given segment has been set to said corresponding set of values. An on disk lookup is performed in parallel of a second on disk segment index that is not included in said subset of on disk segment indexes each of which has associated therewith a corresponding bloom filter.

Patent Agency Ranking