Opportunistic gossip-type dissemination of node metrics in server clusters

    公开(公告)号:US10713223B2

    公开(公告)日:2020-07-14

    申请号:US15944638

    申请日:2018-04-03

    Abstract: Among heterogeneous nodes in a cluster, one node's capabilities can vary widely from that of others in the same cluster, for example, in a cluster of storage servers. As each of the clients/writers to the cluster may contact different server nodes in the cluster over time, with each contact the client/writer may receive server metric information, including both the contacted node's current metrics as well as metrics for any other nodes of which the contacted node is aware. The client/writer may provide updated information to the contacted node regarding the metrics for other nodes of which the client/writer is aware or has contacted. The exchange of metric information may be piggybacked upon read/write requests to each node to conserve bandwidth.

    HIGH AVAILABILITY DATABASE THROUGH DISTRIBUTED STORE

    公开(公告)号:US20190042638A1

    公开(公告)日:2019-02-07

    申请号:US15666141

    申请日:2017-08-01

    Abstract: Techniques are disclosed relating to a database system synchronizing a current state of the database system among a plurality of nodes configured to handle requests for data of the database system stored in a distributed storage with one of the plurality of nodes being currently active and the other nodes of the plurality of nodes being currently standby nodes. In various embodiments, the active node receives a request to perform a transaction that includes committing data to the distributed storage. In response to receiving the request, in some embodiments, the active node commits the data to the distributed storage to update the current state of the database system and causes storing of metadata that provides an indication of the commitment in a transaction log stored in the distributed storage.

    Cloud Storage Class-based Variable Cache Availability

    公开(公告)号:US20220245094A1

    公开(公告)日:2022-08-04

    申请号:US17162501

    申请日:2021-01-29

    Abstract: Techniques are disclosed relating to managing distributed storage of data for various entities according to classifications for these entities. A database node of a distributed storage system may receive, from a first entity of a plurality of entities, a request to store a set of data. The database node may further obtain metadata associated with the first entity, wherein the metadata specifies one of a plurality of classifications for the entities. The database node may provide the set of data to one or more of a plurality of caches for storage. The caches may be located in two or more availability zones and are configured to store the set of data based on the classification for the first entity identified in the metadata associated with the first entity. The database node may also store the set of data in a shared object storage coupled to the database node.

    Cookie-based network location of storage nodes in cloud

    公开(公告)号:US12047448B2

    公开(公告)日:2024-07-23

    申请号:US18056013

    申请日:2022-11-16

    CPC classification number: H04L67/1097 G06F9/4416 G06F16/953

    Abstract: Techniques are disclosed relating to storing location information about storage nodes in cookies. A cloud-based service may send location requests to an orchestration service that instantiated storage nodes included in a storage cluster of the cloud-based service. The cloud-based service may receive location information that identifies in which computer zone that a given storage node is located. The cloud-based service may store the location information in cookies at a metadata store that is shared among the storage nodes. The cloud-based service may receive, from a client node, a search request to identify ones of the storage nodes that store particular data. The cloud-based service may return a set of cookies corresponding to identified storage nodes. The set of cookies may enable the client node to determine whether there is a storage node that stores the particular data and is within the same computer zone as the client node.

    Grey failure handling in distributed storage systems

    公开(公告)号:US11622000B2

    公开(公告)日:2023-04-04

    申请号:US17161831

    申请日:2021-01-29

    Abstract: Techniques are disclosed relating to managing distributed storage of data across availability zones and the replication of data in case of storage server failures. A distributed storage system may include storage servers distributed across availability zones with an auditor instantiated in at least one storage server. The auditor manages the replication of data in the event of one or more storage servers failure in an availability zone. In the event of the failure, the auditor may determine the extent of the failure and whether the failure involves a small number or a large number of storage servers. In the event a large number of storage servers being affected, the auditor may delay replication of data to see if the failure is temporary and avoid unwanted data transfer of large amounts of data across availability zones.

    COOKIE-BASED NETWORK LOCATION OF STORAGE NODES IN CLOUD

    公开(公告)号:US20230071938A1

    公开(公告)日:2023-03-09

    申请号:US18056013

    申请日:2022-11-16

    Abstract: Techniques are disclosed relating to storing location information about storage nodes in cookies. A cloud-based service may send location requests to an orchestration service that instantiated storage nodes included in a storage cluster of the cloud-based service. The cloud-based service may receive location information that identifies in which computer zone that a given storage node is located. The cloud-based service may store the location information in cookies at a metadata store that is shared among the storage nodes. The cloud-based service may receive, from a client node, a search request to identify ones of the storage nodes that store particular data. The cloud-based service may return a set of cookies corresponding to identified storage nodes. The set of cookies may enable the client node to determine whether there is a storage node that stores the particular data and is within the same computer zone as the client node.

    Fencing out nodes in a distributed clustered system

    公开(公告)号:US11016990B2

    公开(公告)日:2021-05-25

    申请号:US15667285

    申请日:2017-08-02

    Abstract: Techniques are disclosed relating to fencing out a first one of a plurality of nodes configured to handle requests for data stored in a distributed storage. A database system, in various embodiments, stores a value indicating that the first node is permitted to update a catalog stored at a metadata server. In response to a determination to prevent the first node from updating the catalog and writing to the distributed storage, in various embodiments, the database system updates the value to indicate that the first node is not permitted to update the catalog and instructs the distributed storage to prevent write operations to a particular portion allocated to the first node for writing data.

    Decentralized, resource aware load distribution in a distributed system

    公开(公告)号:US10693951B2

    公开(公告)日:2020-06-23

    申请号:US15610964

    申请日:2017-06-01

    Abstract: Distributed Systems are becoming very large and are being served by 10s of 1000s of individual machines. Among heterogeneous nodes, one node's capabilities can vary widely from that of others in the same cluster, for example, in a cluster of storage servers. Each of the clients/writers may retrieve, periodically, from all the servers, important metrics such as free disk space capacity, average disk IO utilization over the last N minutes, etc. We call these client to nodes (servers) messages as “periodic metrics query.” Using received metrics, clients dynamically assign weights to each of the servers as an indication of their current capabilities. Server metrics and or weights are distributed across the clients, and each client may make independent placement decisions based on their view of the cluster. Because clients are using substantially the same information for making decisions on placement, the result is improved balance across the servers.

    FENCING OUT NODES IN A DISTRIBUTED CLUSTERED SYSTEM

    公开(公告)号:US20190045007A1

    公开(公告)日:2019-02-07

    申请号:US15667285

    申请日:2017-08-02

    Abstract: Techniques are disclosed relating to fencing out a first one of a plurality of nodes configured to handle requests for data stored in a distributed storage. A database system, in various embodiments, stores a value indicating that the first node is permitted to update a catalog stored at a metadata server. In response to a determination to prevent the first node from updating the catalog and writing to the distributed storage, in various embodiments, the database system updates the value to indicate that the first node is not permitted to update the catalog and instructs the distributed storage to prevent write operations to a particular portion allocated to the first node for writing data.

Patent Agency Ranking