Maintaining real-time cache coherency during distributed computational functions

    公开(公告)号:US11809323B1

    公开(公告)日:2023-11-07

    申请号:US17846388

    申请日:2022-06-22

    CPC classification number: G06F12/0828 G06F12/0815 G06F2212/621

    Abstract: Apparatus and method for maintaining real-time coherency between a local cache of a target device and a client cache of a source device during execution of a distributed computational function. In some embodiments, a source device, such as a host computer, is coupled via a network interface to a target device, such as a data storage device. A storage compute function (SCF) command is transferred from the source device to the target device. A local cache of the target device accumulates output data during the execution of an associated SCF over an execution time interval. Real-time coherency is maintained between the contents of the local cache and a client cache of the source device, so that the client cache retains continuously updated copies of the contents of the local cache during execution of the SCF. The coherency can be carried out on a time-based granularity or an operational granularity.

    PERFORMING REMOTE HIDDEN COMPUTE FUNCTIONS IN ONE OR MORE PROCESSING DEVICES

    公开(公告)号:US20230418959A1

    公开(公告)日:2023-12-28

    申请号:US17846871

    申请日:2022-06-22

    CPC classification number: G06F21/62 G06F2221/2143

    Abstract: Apparatus and method for executing hidden computational functions in a distributed data processing environment. In some embodiments, a trust boundary includes a target device such as a storage device, and a source device such as a client device in a computer network. A storage device processor executes a hidden command function (HCF) routine to accumulate HCF output data in a local cache responsive to an HCF command received from the client device over a data interface. The processor further establishes a smaller retention boundary within the trust boundary that includes the storage device and excludes the client device. The HCF output data are stored locally in a non-volatile memory (NVM) of the storage device while not transferring any portion of the HCF output data outside the retention boundary, including to the client device. The HCF routine can update a block-chain ledger or take some other form to provide data security.

    In-line data flow for computational storage

    公开(公告)号:US11675540B2

    公开(公告)日:2023-06-13

    申请号:US17394709

    申请日:2021-08-05

    CPC classification number: G06F3/0659 G06F3/0604 G06F3/0679

    Abstract: A system includes a storage device and a computational storage processor. The storage device includes media. The computational storage processor is configured to, after issuance of a single command from a host device, receive data corresponding to the command, process the data as the data is received using a filter program and provide results data from the processed data.

    DATA STREAMING FOR COMPUTATIONAL STORAGE

    公开(公告)号:US20220236911A1

    公开(公告)日:2022-07-28

    申请号:US17158187

    申请日:2021-01-26

    Abstract: Methods, apparatuses, and computer-readable media for streaming arbitrarily large amounts of data through computational storage programs of a computational storage device. A computational storage device comprises a storage media, a computational storage processor, and a controller. A firmware of the controller comprises a plurality of streaming drivers, each associated with a data source or data destination of the storage device. The firmware further comprises a buffer abstraction layer operable to read data from a data source through an associated ingress streaming driver of the plurality of streaming drivers to provide a source data stream for a computational storage program executing on the computational storage processor. The buffer abstraction layer is further operable to receive a destination data stream from the computational storage program and write data to a data destination through an associated egress streaming driver of the plurality of streaming drivers.

    Performing remote hidden compute functions in one or more processing devices

    公开(公告)号:US12079355B2

    公开(公告)日:2024-09-03

    申请号:US17846871

    申请日:2022-06-22

    CPC classification number: G06F21/62 G06F2221/2143

    Abstract: Apparatus and method for executing hidden computational functions in a distributed data processing environment. In some embodiments, a trust boundary includes a target device such as a storage device, and a source device such as a client device in a computer network. A storage device processor executes a hidden command function (HCF) routine to accumulate HCF output data in a local cache responsive to an HCF command received from the client device over a data interface. The processor further establishes a smaller retention boundary within the trust boundary that includes the storage device and excludes the client device. The HCF output data are stored locally in a non-volatile memory (NVM) of the storage device while not transferring any portion of the HCF output data outside the retention boundary, including to the client device. The HCF routine can update a block-chain ledger or take some other form to provide data security.

    DISTRIBUTED DATA STORAGE SYSTEM WITH PEER-TO-PEER OPTIMIZATION

    公开(公告)号:US20230418685A1

    公开(公告)日:2023-12-28

    申请号:US18213692

    申请日:2023-06-23

    CPC classification number: G06F9/5083 G06F3/0613 G06F3/067 G06F3/0631 G06F21/44

    Abstract: Method and apparatus for offloading upstream processing tasks to peer groups of downstream data storage devices. A peer control circuit forms a peer group of storage devices in response to a detected processing bottleneck associated with a network controller. One of the storage devices in the peer group is designated as a primary device, and is responsible for interface communications, for subdividing the processing task for execution by secondary devices in the peer group, and coordinating overall execution. The peer group and the processing task are selected to avoid or minimize the processing bottleneck at the network controller level while maintaining ongoing data transfer performance at the storage device level. A list of available device resources and capabilities may be maintained by the peer control circuit. Offloaded tasks can include data rebuilds, cryptographic functions, new device authentication operations, and the like. Multiple overlapping peer groups can be formed as needed.

Patent Agency Ranking