Scheduling requests based on resource information

    公开(公告)号:US11030001B2

    公开(公告)日:2021-06-08

    申请号:US16516574

    申请日:2019-07-19

    IPC分类号: G06F9/48 G06F9/50 G06F11/30

    摘要: A method for execution by a request scheduler includes receiving a set of requests for execution from at least one request issuer. Resource requirements are determined for each of the set of requests, and current resource availability data is determined for resources indicated in the resource requirements. Scheduling data is generated for the set of requests based on the resource requirements and the current resource availability data. A first subset of the set of requests are added to a queue in response to the scheduling data indicating the first subset of the set of requests be queued for execution. Execution of the set of requests is facilitated in accordance with the scheduling data by facilitating immediate, simultaneous execution of a second subset of the set of requests and by facilitating serial execution of the first subset of the set of requests.

    Indicating multiple encoding schemes in a dispersed storage network

    公开(公告)号:US10958731B2

    公开(公告)日:2021-03-23

    申请号:US16297916

    申请日:2019-03-11

    发明人: Ethan S. Wozniak

    IPC分类号: H04L29/08 H04L12/879

    摘要: A method includes transmitting a first write request that includes a first encoded data slice of a first data object encoded under a first encoding scheme, and a first slice identifier corresponding to the first encoded data slice assigned to a first memory location of a distributed storage network (DSN) based on the first slice identifier. A second write request that includes a second encoded data slice of the first data object encoded under a second encoding scheme, and a second slice identifier corresponding to the second encoded data slice, is transmitted, and the second encoded data slice is assigned to a second memory location of the DSN based on the second slice identifier. A request to access the first data object is received. A derived second slice identifier is generated in response to determining that the first data object requested for access is stored under multiple encoding schemes.

    IDENTIFYING AND PROCESSING PREDEFINED DISPERSED STORAGE NETWORK WORKFLOWS

    公开(公告)号:US20200333979A1

    公开(公告)日:2020-10-22

    申请号:US16390731

    申请日:2019-04-22

    IPC分类号: G06F3/06 G06F11/10

    摘要: A method includes receiving, by a computing entity of a dispersed storage network (DSN), a request from a requesting device of the DSN to perform an encoded data slice operation. The request includes an indication that the encoded data slice operation is a stage in a predefined DSN workflow. The method further includes sending, by the computing entity, a response to the requesting device that includes a DSN workflow tag, wherein the DSN workflow tag includes an identifier of the stage in the predefined DSN workflow. The method further includes enabling a performance optimization mode. The performance optimization mode includes one or more performance optimization procedures for one or more of: the stage and one or more future stages of the predefined DSN workflow. The method further includes executing the encoded data slice operation in accordance with the performance optimization mode.

    Caching for unique combination reads in a dispersed storage network

    公开(公告)号:US10652350B2

    公开(公告)日:2020-05-12

    申请号:US15174596

    申请日:2016-06-06

    发明人: Ethan S. Wozniak

    摘要: A method includes receiving a first access request that indicates a first data object stored as encoded slices in a plurality of storage units. A first desired slice set is selected, based on the requesting module, that includes a first subset of encoded slices of the first data object. Absent slice data is generated based on searching a local cache, indicating an encoded slice not present in the local cache. A read request to read the encoded slice indicated by the absent slice data from one of the storage units is transmitted. The encoded slice indicated by the absent slice data from the storage unit is received and the local cache is updated to include the encoded slice. The first data object is regenerated for transmission to the first requesting module by decoding the first subset of encoded slices in the first desired slice set.

    MEMORY COMPACTION FOR APPEND-ONLY FORMATTED DATA IN A DISTRIBUTED STORAGE NETWORK

    公开(公告)号:US20200026780A1

    公开(公告)日:2020-01-23

    申请号:US16037757

    申请日:2018-07-17

    IPC分类号: G06F17/30

    摘要: A processing module of a memory storage unit includes an interface configured to interface and communicate with a communication system, a memory that stores operational instructions, and processing circuitry operably coupled to the interface and to the memory that is configured to execute the operational instructions to manage data stored using append-only formatting. When the processing module determines that a section of the memory includes invalid data and the amount of invalid data compares unfavorably to a predetermined limit, the processing module determines a rate for execution of a compaction routine for the section of memory, where the rate is based on a proportion, integral and derivative (PID) function that is based on a target usage level of the memory and a current usage level of the memory.

    INDICATING MULTIPLE ENCODING SCHEMES IN A DISPERSED STORAGE NETWORK

    公开(公告)号:US20190208016A1

    公开(公告)日:2019-07-04

    申请号:US16297916

    申请日:2019-03-11

    发明人: Ethan S. Wozniak

    IPC分类号: H04L29/08 H04L12/879

    CPC分类号: H04L67/1097 H04L49/901

    摘要: A method includes transmitting a first write request that includes a first encoded data slice of a first data object encoded under a first encoding scheme, and a first slice identifier corresponding to the first encoded data slice assigned to a first memory location of a distributed storage network (DSN) based on the first slice identifier. A second write request that includes a second encoded data slice of the first data object encoded under a second encoding scheme, and a second slice identifier corresponding to the second encoded data slice, is transmitted, and the second encoded data slice is assigned to a second memory location of the DSN based on the second slice identifier. A request to access the first data object is received. A derived second slice identifier is generated in response to determining that the first data object requested for access is stored under multiple encoding schemes.

    EXTRA WRITE SCALING FOR PERFORMANCE AND RELIABILITY

    公开(公告)号:US20190155525A1

    公开(公告)日:2019-05-23

    申请号:US16255986

    申请日:2019-01-24

    摘要: A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and memory such that the processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations. For example, the computing device monitors storage unit (SU)-based write transfer rates and SU-based write failure rates associated with each of the SUs for a write request of encoded data slices (EDSs) to the SUs within the DSN. The computing device generates and maintains a SU write performance distribution based on monitoring of the SU-based write transfer rates and the SU-based write failure rates and adaptively adjusts a trimmed write threshold number of EDSs and/or a target width of EDSs for write requests of sets of EDSs to the SUs within the DSN.