Methods and systems for error detection and correction in a distributed storage system

    公开(公告)号:US11740822B2

    公开(公告)日:2023-08-29

    申请号:US17244608

    申请日:2021-04-29

    IPC分类号: G06F3/06 G06F11/30 G06F9/455

    摘要: A method for storing data, comprising: obtaining, from a metadata node and by file system client executing on a client application node, a data layout, generating, by the client application node, an error detection value (EDV) for the data stored on the client application node; generating, by a memory hypervisor module executing on the client application node, at least one input/output (I/O) request specifying a location in a storage pool, wherein the location is determined using the data layout; issuing, by the memory hypervisor module, the at least one I/O request to the storage pool, wherein processing the at least one I/O request results in at least a portion of the data being stored at the location; and after issuing the at least one I/O request to the storage pool, transmitting the EDV to the metadata node, wherein the metadata node stores the EDV.

    Methods and systems for storing data in a distributed system using offload components

    公开(公告)号:US11604610B2

    公开(公告)日:2023-03-14

    申请号:US17244495

    申请日:2021-04-29

    IPC分类号: G06F3/06

    摘要: A method for storing data, the method comprising receiving, by an offload component in a client application node, a request originating from an application executing in an application container on the client application node, wherein the request is associated with data and wherein the offload component is located in a hardware layer of the client application node, and processing, by the offload component, the request by a file system (FS) client and a memory hypervisor module executing in a modified client FS container on the offload component, wherein processing the request results in at least a portion of the data in a location in a storage pool.

    METHODS AND SYSTEMS FOR SEAMLESS TIERING IN A DISTRIBUTED STORAGE SYSTEM

    公开(公告)号:US20220350778A1

    公开(公告)日:2022-11-03

    申请号:US17244305

    申请日:2021-04-29

    IPC分类号: G06F16/182 G06F16/14

    摘要: A method for processing requests, the method comprising: receiving, from a client application node and by a metadata node, a request for a data layout, determining a QoS tag associated with the request, identifying at least one file system block (FSB) in a sparse virtual space, wherein the FSB is mapped to a location in a storage pool that is associated with the QoS tag, generating the data layout based on the at least one identified FSB; and providing the data layout to the client application, wherein the client application node uses the data layout to directly write data to the location in the storage pool, wherein the metadata node does not participate in the writing of the data to the location in the storage pool.

    METHODS AND SYSTEMS FOR ERROR DETECTION AND CORRECTION IN A DISTRIBUTED STORAGE SYSTEM

    公开(公告)号:US20220350516A1

    公开(公告)日:2022-11-03

    申请号:US17244608

    申请日:2021-04-29

    IPC分类号: G06F3/06 G06F9/455

    摘要: A method for storing data, comprising: obtaining, from a metadata node and by file system client executing on a client application node, a data layout, generating, by the client application node, an error detection value (EDV) for the data stored on the client application node; generating, by a memory hypervisor module executing on the client application node, at least one input/output (I/O) request specifying a location in a storage pool, wherein the location is determined using the data layout; issuing, by the memory hypervisor module, the at least one I/O request to the storage pool, wherein processing the at least one I/O request results in at least a portion of the data being stored at the location; and after issuing the at least one I/O request to the storage pool, transmitting the EDV to the metadata node, wherein the metadata node stores the EDV.

    Methods and systems for servicing data requests in a multi-node system

    公开(公告)号:US11150845B2

    公开(公告)日:2021-10-19

    申请号:US16672236

    申请日:2019-11-01

    IPC分类号: G06F3/06 G06F12/1081 G06F9/50

    摘要: A method for processing requests includes receiving a request comprising a virtual address, wherein the request is associated with an application executing on an operating system, identifying, based on data specified in the request, a logical volume associated with the data, making a first determination, based on the logical volume, that the logical volume is managed by a remote node, generating a data layout request to receive a data layout of the data from the remote node, receiving the data layout, wherein the data layout specifies a first physical address on the remote node that stores the data, initiating a copy request to copy the data from the first physical address to a second physical address on a local node, generating, based on the copy request, a virtual-to-physical address mapping between the virtual address and the second physical address; and initiating processing the request using the virtual-to-physical address mapping.