-
公开(公告)号:US11030001B2
公开(公告)日:2021-06-08
申请号:US16516574
申请日:2019-07-19
发明人: Anthony J. Baldocchi , Shaorong Liu , Jordan H. Williams , Ethan S. Wozniak , Manish Motwani , Ilya Volvovski
摘要: A method for execution by a request scheduler includes receiving a set of requests for execution from at least one request issuer. Resource requirements are determined for each of the set of requests, and current resource availability data is determined for resources indicated in the resource requirements. Scheduling data is generated for the set of requests based on the resource requirements and the current resource availability data. A first subset of the set of requests are added to a queue in response to the scheduling data indicating the first subset of the set of requests be queued for execution. Execution of the set of requests is facilitated in accordance with the scheduling data by facilitating immediate, simultaneous execution of a second subset of the set of requests and by facilitating serial execution of the first subset of the set of requests.
-
公开(公告)号:US10958731B2
公开(公告)日:2021-03-23
申请号:US16297916
申请日:2019-03-11
发明人: Ethan S. Wozniak
IPC分类号: H04L29/08 , H04L12/879
摘要: A method includes transmitting a first write request that includes a first encoded data slice of a first data object encoded under a first encoding scheme, and a first slice identifier corresponding to the first encoded data slice assigned to a first memory location of a distributed storage network (DSN) based on the first slice identifier. A second write request that includes a second encoded data slice of the first data object encoded under a second encoding scheme, and a second slice identifier corresponding to the second encoded data slice, is transmitted, and the second encoded data slice is assigned to a second memory location of the DSN based on the second slice identifier. A request to access the first data object is received. A derived second slice identifier is generated in response to determining that the first data object requested for access is stored under multiple encoding schemes.
-
公开(公告)号:US20200333979A1
公开(公告)日:2020-10-22
申请号:US16390731
申请日:2019-04-22
发明人: David E. Reese , Ethan S. Wozniak
摘要: A method includes receiving, by a computing entity of a dispersed storage network (DSN), a request from a requesting device of the DSN to perform an encoded data slice operation. The request includes an indication that the encoded data slice operation is a stage in a predefined DSN workflow. The method further includes sending, by the computing entity, a response to the requesting device that includes a DSN workflow tag, wherein the DSN workflow tag includes an identifier of the stage in the predefined DSN workflow. The method further includes enabling a performance optimization mode. The performance optimization mode includes one or more performance optimization procedures for one or more of: the stage and one or more future stages of the predefined DSN workflow. The method further includes executing the encoded data slice operation in accordance with the performance optimization mode.
-
公开(公告)号:US10652350B2
公开(公告)日:2020-05-12
申请号:US15174596
申请日:2016-06-06
发明人: Ethan S. Wozniak
IPC分类号: G06F15/167 , H04L29/08 , G06F12/0813 , G06F12/0868 , G06F16/172
摘要: A method includes receiving a first access request that indicates a first data object stored as encoded slices in a plurality of storage units. A first desired slice set is selected, based on the requesting module, that includes a first subset of encoded slices of the first data object. Absent slice data is generated based on searching a local cache, indicating an encoded slice not present in the local cache. A read request to read the encoded slice indicated by the absent slice data from one of the storage units is transmitted. The encoded slice indicated by the absent slice data from the storage unit is received and the local cache is updated to include the encoded slice. The first data object is regenerated for transmission to the first requesting module by decoding the first subset of encoded slices in the first desired slice set.
-
公开(公告)号:US20200026780A1
公开(公告)日:2020-01-23
申请号:US16037757
申请日:2018-07-17
IPC分类号: G06F17/30
摘要: A processing module of a memory storage unit includes an interface configured to interface and communicate with a communication system, a memory that stores operational instructions, and processing circuitry operably coupled to the interface and to the memory that is configured to execute the operational instructions to manage data stored using append-only formatting. When the processing module determines that a section of the memory includes invalid data and the amount of invalid data compares unfavorably to a predetermined limit, the processing module determines a rate for execution of a compaction routine for the section of memory, where the rate is based on a proportion, integral and derivative (PID) function that is based on a target usage level of the memory and a current usage level of the memory.
-
公开(公告)号:US10523781B2
公开(公告)日:2019-12-31
申请号:US16130431
申请日:2018-09-13
发明人: Ethan S. Wozniak , Manish Motwani
IPC分类号: H04L29/08 , G06F9/50 , G06F11/14 , G06F11/34 , G06F13/26 , G06F16/00 , G06F16/24 , G06F16/27 , G06F16/29 , G06F16/43 , G06F16/182 , G06F16/185 , G06F16/245 , G06F16/248 , G06F16/25 , G06F16/28 , G06F16/22 , G06F16/2455 , G06F16/2458 , H04L12/26 , G06F1/3296 , G06F11/07 , G06F11/10 , G06F21/10 , G06F21/60 , G06F21/80 , H03M13/37 , H04L9/08 , H04L9/14 , H04L9/16 , H04L29/06 , H04N21/218 , H04N21/231 , H04N21/232 , G06F21/62 , H03M13/15
摘要: A method for optimizing scheduler selection by a distributed storage (DS) unit of a dispersed storage network (DSN) begins with a DS unit receiving a dispersed storage error function from a DSN user and queries DS elements to determine measured throughput and measured latency. The method resumes when the DS unit receives measured throughput and measured latency from the DSN elements and selects a scheduler based on the measured throughput and measured latency. The method continues with the DS unit receiving a different updated measured throughput and measured latency from the DSN elements and selecting a different scheduler.
-
7.
公开(公告)号:US10423362B2
公开(公告)日:2019-09-24
申请号:US15263810
申请日:2016-09-13
IPC分类号: G06F11/00 , G06F3/06 , G06F11/14 , H04L29/08 , G06F11/10 , H03M13/11 , H03M13/15 , G06F9/48 , G06F9/50 , G06F12/0866 , G06F12/0891 , G06F15/173 , H03M13/37 , H03M13/00 , H04L29/06
摘要: A first dispersed storage and task (DST) processing unit operates to store data as one or more first sets of encoded data slices in a set of storage units utilizing a first information dispersal algorithm having a first decode threshold number and determine whether to store the data as one or more second sets of encoded data slices in the set of storage units utilizing a second IDA having a second decode threshold number. When determined to store the data as the one or more second sets of encoded data slices, the first DST processing unit further operates to encode the data utilizing the second IDA to produce the one or more second sets of encoded data slices, and facilitate storage of the one or more second sets of encoded data slices in at least a subset of the set of storage units.
-
公开(公告)号:US10346246B2
公开(公告)日:2019-07-09
申请号:US15264011
申请日:2016-09-13
IPC分类号: G06F11/10 , G06F3/06 , G06F11/14 , H03M13/11 , H04L29/08 , G06F9/48 , G06F9/50 , G06F12/0866 , G06F12/0891 , G06F15/173 , H03M13/37 , H03M13/15 , H03M13/00 , H04L29/06 , H04L29/12
摘要: A method for use in a dispersed storage network operates to initiate retrieval of a decode threshold number of encoded data slices of each of one or more sets of encoded data slices in accordance with a first recovery approach. When a recovery time frame expires prior to receiving a second decode threshold number of encoded data slices of each of the one or more second sets of encoded data slices, the method proceeds to select a second data recovery approach that differs from the first recovery approach; recover a sufficient number of encoded data slices in accordance with the second data recovery approach; and dispersed storage error decode the sufficient number of encoded data slices to produce recovered data.
-
公开(公告)号:US20190208016A1
公开(公告)日:2019-07-04
申请号:US16297916
申请日:2019-03-11
发明人: Ethan S. Wozniak
IPC分类号: H04L29/08 , H04L12/879
CPC分类号: H04L67/1097 , H04L49/901
摘要: A method includes transmitting a first write request that includes a first encoded data slice of a first data object encoded under a first encoding scheme, and a first slice identifier corresponding to the first encoded data slice assigned to a first memory location of a distributed storage network (DSN) based on the first slice identifier. A second write request that includes a second encoded data slice of the first data object encoded under a second encoding scheme, and a second slice identifier corresponding to the second encoded data slice, is transmitted, and the second encoded data slice is assigned to a second memory location of the DSN based on the second slice identifier. A request to access the first data object is received. A derived second slice identifier is generated in response to determining that the first data object requested for access is stored under multiple encoding schemes.
-
公开(公告)号:US20190155525A1
公开(公告)日:2019-05-23
申请号:US16255986
申请日:2019-01-24
发明人: Greg R. Dhuse , Jason K. Resch , Ethan S. Wozniak
摘要: A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and memory such that the processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations. For example, the computing device monitors storage unit (SU)-based write transfer rates and SU-based write failure rates associated with each of the SUs for a write request of encoded data slices (EDSs) to the SUs within the DSN. The computing device generates and maintains a SU write performance distribution based on monitoring of the SU-based write transfer rates and the SU-based write failure rates and adaptively adjusts a trimmed write threshold number of EDSs and/or a target width of EDSs for write requests of sets of EDSs to the SUs within the DSN.
-
-
-
-
-
-
-
-
-