On-demand parallel processing of objects using data connector components

    公开(公告)号:US12169483B2

    公开(公告)日:2024-12-17

    申请号:US17242399

    申请日:2021-04-28

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for on-demand creation and/or utilization of containers and/or serverless threads for hosting data connector components. The data connector components can be used to perform integrity checking, anomaly detection, and file system metadata analysis associated with objects stored within an object store. The data connector components may be configured to execute machine learning functionality to perform operations and tasks. The data connector components can perform full scans or incremental scans. The data connector components may be stateless, and thus may be offlined, upgraded, onlined, and/or have tasks transferred between data connector components. Results of operations performed by the data connector components upon base objects may be stored within sibling objects.

    FLEXIBLE TIERING OF SNAPSHOTS TO ARCHIVAL STORAGE IN REMOTE OBJECT STORES

    公开(公告)号:US20230409523A1

    公开(公告)日:2023-12-21

    申请号:US18366053

    申请日:2023-08-07

    Applicant: NetApp Inc.

    CPC classification number: G06F16/128 G06F11/1458

    Abstract: Techniques are provided for tiering snapshots to archival storage in remote object stores. A restore time metric, indicating that objects comprising snapshot data of snapshots created within a threshold timespan are to be available within a storage tier of a remote object store for performing restore operations, may be identified. A scanner may be executed to evaluate snapshots using the restore time metric to identify a set of candidate snapshots for archival from the storage tier to an archival storage tier of the remote object store. For each candidate snapshot within the set of candidate snapshots, the scanner may evaluate metadata associated with the candidate snapshot to identity one or more objects eligible for archival from the storage tier to the archival storage tier, and may archive the one or more objects from the storage tier to the archival storage tier.

    IMMUTABLE SNAPSHOT COPIES STORED IN WRITE ONCE READ MANY (WORM) STORAGE

    公开(公告)号:US20230205446A1

    公开(公告)日:2023-06-29

    申请号:US18178706

    申请日:2023-03-06

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for storing immutable snapshot copes in write once read many (WORM) storage. A snapshot of a volume may be stored into one or more objects formatted according to an object format. An expiry time may be assigned to the snapshot and the one or more objects based upon a creation time of the snapshot and a retention time. The one or more objects may be stored within a remote object store. The one or more objects are retained in an immutable state and cannot be deleted until expiration of the expiry time. In response to identifying an existing object within the remote object store comprising shared snapshot data referenced by the snapshot, an assigned expiry time of the existing object may be modified based upon the expiry time of the snapshot to create a modified expiry time for the existing object.

    DATA CONNECTOR COMPONENT FOR IMPLEMENTING INTEGRITY CHECKING, ANOMALY DETECTION, AND FILE SYSTEM METADATA ANALYSIS

    公开(公告)号:US20220138207A1

    公开(公告)日:2022-05-05

    申请号:US17242356

    申请日:2021-04-28

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for on-demand creation and/or utilization of containers and/or serverless threads for hosting data connector components. The data connector components can be used to perform integrity checking, anomaly detection, and file system metadata analysis associated with objects stored within an object store. The data connector components may be configured to execute machine learning functionality to perform operations and tasks. The data connector components can perform full scans or incremental scans. The data connector components may be stateless, and thus may be offlined, upgraded, onlined, and/or have tasks transferred between data connector components. Results of operations performed by the data connector components upon base objects may be stored within sibling objects.

Patent Agency Ranking