Efficient resource reclamation after deletion of slice from common file

    公开(公告)号:US10511665B2

    公开(公告)日:2019-12-17

    申请号:US15838725

    申请日:2017-12-12

    摘要: A distributed storage network (DSN) employs one or more distributed storage task execution (DST EX) units for dispersed storage of encoded data slices. A delete-slice request associated with a first encoded data slice is received at a DST EX unit, the encoded data slice is packed into a common file with other encoded data slices, and the common file is stored in a distributed storage (DS) memory included in the DST EX unit. Each encoded data slice packed into the common file is associated with a file offset within the common file. The DST EX unit identifies a file offset of the first encoded data slice within the common file. The DST EX unit releases the portion of the DS memory associated with the particular file offset within the common file to a file system maintained by the DST EX unit.

    PREDICTIVE REBALANCING ACCORDING TO FUTURE USAGE EXPECTATIONS

    公开(公告)号:US20180337997A1

    公开(公告)日:2018-11-22

    申请号:US16048011

    申请日:2018-07-27

    IPC分类号: H04L29/08 G06F11/10

    摘要: A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and processing circuitry operably coupled to the interface and to the memory. The processing circuitry is configured to execute the operational instructions to perform various operations and functions. The computing device detects at least one available memory device within a storage unit (SU). The computing device identifies storage capacities of each of the memory devices within the SU and identifies a DSN address range associated with the SU. The computing device maps the DSN address range to each of the memory devices within the SU based on the storage capacities to generate a memory mapping of the memory devices within the SU. The computing device then facilitates redistribution of some EDS from a first memory device to the at least one available memory device within the SU.

    Migrating data in a distributed storage network

    公开(公告)号:US10089036B2

    公开(公告)日:2018-10-02

    申请号:US15827073

    申请日:2017-11-30

    IPC分类号: G06F15/167 G06F3/06 H04L29/08

    摘要: A method begins by a processing modules of a storage unit (SU) of a dispersed storage network (DSN) determining to migrate a set of encoded data slices from the first storage format to a second storage format. The method continues with the SU selecting the second storage format for the set of EDSs and selecting a second DSN memory configured to store the set of EDSs based on the second storage format. The method continues with the SU determining a first migration rate and migrating a first subset of the set of EDSs from the first DSN memory to the second DSN memory. The method continues with the SU monitoring activity associated with the DSN memory, selecting a second migration rate based on the activity associated with the at least one of the first DSN memory or the second DSN memory, and migrating a second subset of the set of EDSs based on the second migration rate.

    MIGRATING DATA IN A DISTRIBUTED STORAGE NETWORK

    公开(公告)号:US20180081586A1

    公开(公告)日:2018-03-22

    申请号:US15827073

    申请日:2017-11-30

    IPC分类号: G06F3/06 H04L29/08

    摘要: A method begins by a processing modules of a storage unit (SU) of a dispersed storage network (DSN) determining to migrate a set of encoded data slices from the first storage format to a second storage format. The method continues with the SU selecting the second storage format for the set of EDSs and selecting a second DSN memory configured to store the set of EDSs based on the second storage format. The method continues with the SU determining a first migration rate and migrating a first subset of the set of EDSs from the first DSN memory to the second DSN memory. The method continues with the SU monitoring activity associated with the DSN memory, selecting a second migration rate based on the activity associated with the at least one of the first DSN memory or the second DSN memory, and migrating a second subset of the set of EDSs based on the second migration rate.

    Zone storage—quickly returning to a state of consistency following an unexpected event

    公开(公告)号:US10552341B2

    公开(公告)日:2020-02-04

    申请号:US15435385

    申请日:2017-02-17

    IPC分类号: G06F12/121 G06F12/0813

    摘要: Systems and Methods for data storage in a distributed storage network are disclosed. Unexpected errors can adversely affect consistency of both the content of a write (including the slice data), and the synchronicity between the written slices and metadata structures. To maintain consistency between these data structures, a sequencing of the order of writes and flushes to the memory devices for the different data structures may be enforced as follows: First: Slice content data is first written to the volatile memory (e.g. a cache memory) of a DS unit; Second: the Slice content data stored in volatile memory is “flushed” to a non-volatile bin (which bin is associated with a group of physical memory blocks in non-volatile memory); Third: after the flush of the slice content data to the bin (i.e. data is durable on the media device): metadata relating to the data is written.

    Modifying and utilizing a file structure in a dispersed storage network

    公开(公告)号:US10528282B2

    公开(公告)日:2020-01-07

    申请号:US15842596

    申请日:2017-12-14

    IPC分类号: G06F13/00 G06F3/06 G06F11/10

    摘要: A method for execution by a storage unit of a dispersed storage network includes receiving a slice access request that includes a slice name. A first function is performed on the slice name to produce a bucket file identifier. A second function is performed on the slice name to produce a bucket identifier. A bucket file of a plurality of bucket files is accessed, where the bucket file is identified by utilizing the bucket file identifier. A bucket of a plurality of buckets within the bucket file is accessed, where the bucket is identified by utilizing the bucket identifier. It is determined to modify a number of buckets in the bucket file based on bucket utilization. An attribute of the second function is modified in response, where the attribute is associated with the number of buckets in the bucket file.