Hierarchical chunking of objects in a distributed storage system
    1.
    发明授权
    Hierarchical chunking of objects in a distributed storage system 有权
    分布式存储系统中对象的分层分块

    公开(公告)号:US09400828B2

    公开(公告)日:2016-07-26

    申请号:US14882205

    申请日:2015-10-13

    Applicant: Google Inc.

    Abstract: Placement of object replicas in a distributed storage system includes, at a first instance, opening a journal for storage of object chunks. An object is received, which comprises one or more chunks. Each chunk comprises one or more storage blocks. The blocks for a single chunk are stored in a single journal. Global metadata for the object is stored, which includes a list of chunks for the object. Local metadata for the chunk is stored, which includes a block list identifying each block of the plurality of blocks. The local metadata is associated with the journal. The journal is later closed. The journal is subsequently replicated to a second instance. The global metadata is updated to reflect the replication, whereas the local metadata is unchanged by the replication.

    Abstract translation: 在分布式存储系统中放置对象副本包括首先打开用于存储对象块的日志。 接收到一个包含一个或多个块的对象。 每个块包括一个或多个存储块。 单个块的块存储在单个日志中。 存储对象的全局元数据,其中包含对象的块列表。 存储块的本地元数据,其包括标识多个块的每个块的块列表。 本地元数据与日记相关联。 该杂志以后关闭。 该日记随后被复制到第二个实例。 全局元数据被更新以反映复制,而复制的本地元数据不变。

    Hierarchical Chunking of Objects in a Distributed Storage System
    2.
    发明申请
    Hierarchical Chunking of Objects in a Distributed Storage System 有权
    分布式存储系统中对象的分层分块

    公开(公告)号:US20160034549A1

    公开(公告)日:2016-02-04

    申请号:US14882205

    申请日:2015-10-13

    Applicant: Google Inc.

    Abstract: Placement of object replicas in a distributed storage system includes, at a first instance, opening a journal for storage of object chunks. An object is received, which comprises one or more chunks. Each chunk comprises one or more storage blocks. The blocks for a single chunk are stored in a single journal. Global metadata for the object is stored, which includes a list of chunks for the object. Local metadata for the chunk is stored, which includes a block list identifying each block of the plurality of blocks. The local metadata is associated with the journal. The journal is later closed. The journal is subsequently replicated to a second instance. The global metadata is updated to reflect the replication, whereas the local metadata is unchanged by the replication.

    Abstract translation: 在分布式存储系统中放置对象副本包括首先打开用于存储对象块的日志。 接收到一个包含一个或多个块的对象。 每个块包括一个或多个存储块。 单个块的块存储在单个日志中。 存储对象的全局元数据,其中包含对象的块列表。 存储块的本地元数据,其包括标识多个块的每个块的块列表。 本地元数据与日记相关联。 该杂志以后关闭。 该日记随后被复制到第二个实例。 全局元数据被更新以反映复制,而复制的本地元数据不变。

    Hierarchical Chunking of Objects in a Distributed Storage System
    3.
    发明申请
    Hierarchical Chunking of Objects in a Distributed Storage System 有权
    分布式存储系统中对象的分层分块

    公开(公告)号:US20150186043A1

    公开(公告)日:2015-07-02

    申请号:US14142706

    申请日:2013-12-27

    Applicant: Google Inc.

    Abstract: Placement of object replicas in a distributed storage system includes, at a first instance, opening a journal for storage of object chunks. Each journal is associated with a single placement policy. An object is received, which comprises a chunk. The object has a placement policy, and the chunk comprises a plurality of storage blocks. The blocks are stored in a journal that matches the placement policy. Global metadata for the object is stored, which includes a list of chunks for the object. Local metadata for the chunk is stored, which includes a block list identifying each block of the plurality of blocks. The local metadata is associated with the journal. The journal is later closed. The journal is subsequently replicated to a second instance according to the placement policy. The global metadata is updated to reflect the replication, whereas the local metadata is unchanged by the replication.

    Abstract translation: 在分布式存储系统中放置对象副本包括首先打开用于存储对象块的日志。 每个日记帐都与单一的刊登位置政策相关联。 接收到一个包含块的对象。 对象具有放置策略,并且该块包括多个存储块。 这些区块存储在与展示位置策略匹配的日记帐中。 存储对象的全局元数据,其中包含对象的块列表。 存储块的本地元数据,其包括标识多个块的每个块的块列表。 本地元数据与日记相关联。 该杂志以后关闭。 该日记随后根据放置政策复制到第二个实例。 全局元数据被更新以反映复制,而复制的本地元数据不变。

    Adaptive and prioritized replication scheduling in storage clusters
    4.
    发明授权
    Adaptive and prioritized replication scheduling in storage clusters 有权
    存储集群中的自适应和优先级复制调度

    公开(公告)号:US09110823B2

    公开(公告)日:2015-08-18

    申请号:US14582055

    申请日:2014-12-23

    Applicant: Google Inc.

    Abstract: In one implementation, groups of objects may be maintained, each group including one or more objects that are to be replicated at one or more of the storage clusters. The objects may be assigned to the groups based on replication choices where at least some of the objects are assigned to multiple ones of the groups. A priority value may be determined and associated with each of the groups, the priority value of a particular group being determined based on priority values associated with objects within the particular group. The objects may be selected, for replication, in a replication order based on the priority value of the groups and replication of the selected objects may be initiated.

    Abstract translation: 在一个实现中,可以维护对象组,每个组包括要在一个或多个存储集群中复制的一个或多个对象。 可以基于复制选择将对象分配给组,其中至少一些对象被分配给多个组。 可以确定优先级值并与每个组相关联,基于与特定组内的对象相关联的优先级值来确定特定组的优先级值。 可以基于组的优先级值以复制顺序来选择对象进行复制,并且可以启动所选对象的复制。

    ADAPTIVE AND PRIORITIZED REPLICATION SCHEDULING IN STORAGE CLUSTERS
    5.
    发明申请
    ADAPTIVE AND PRIORITIZED REPLICATION SCHEDULING IN STORAGE CLUSTERS 有权
    存储群中的自适应和优先复制调度

    公开(公告)号:US20150189013A1

    公开(公告)日:2015-07-02

    申请号:US14582055

    申请日:2014-12-23

    Applicant: Google Inc.

    Abstract: In one implementation, groups of objects may be maintained, each group including one or more objects that are to be replicated at one or more of the storage clusters. The objects may be assigned to the groups based on replication choices where at least some of the objects are assigned to multiple ones of the groups. A priority value may be determined and associated with each of the groups, the priority value of a particular group being determined based on priority values associated with objects within the particular group. The objects may be selected, for replication, in a replication order based on the priority value of the groups and replication of the selected objects may be initiated.

    Abstract translation: 在一个实现中,可以维护对象组,每个组包括要在一个或多个存储集群中复制的一个或多个对象。 可以基于复制选择将对象分配给组,其中至少一些对象被分配给多个组。 可以确定优先级值并与每个组相关联,基于与特定组内的对象相关联的优先级值来确定特定组的优先级值。 可以基于组的优先级值以复制顺序来选择对象进行复制,并且可以启动所选对象的复制。

    System and method for storing metadata for a file in a distributed storage system
    6.
    发明授权
    System and method for storing metadata for a file in a distributed storage system 有权
    用于存储分布式存储系统中文件的元数据的系统和方法

    公开(公告)号:US09330107B1

    公开(公告)日:2016-05-03

    申请号:US13761115

    申请日:2013-02-06

    Applicant: Google Inc.

    CPC classification number: G06F17/30194

    Abstract: A system, computer-readable storage medium storing at least one program, and a computer-implemented method for storing metadata for a file in a distributed storage system is presented. Metadata for a file is generated. A subset of metadata clusters in a distributed storage system is identified to form a quorum of metadata clusters. Requests to store the metadata for the file on the metadata clusters in the distributed storage system are issued, where the requests include high priority requests to store the metadata for the file on at least one of the metadata clusters in the quorum of metadata clusters and normal priority requests to store the metadata in the remaining metadata clusters, the metadata being stored on the at least one of the metadata clusters in the quorum of metadata clusters before being stored on the remaining metadata clusters.

    Abstract translation: 提出了存储至少一个程序的系统,计算机可读存储介质和用于存储分布式存储系统中的文件的元数据的计算机实现的方法。 生成文件的元数据。 识别分布式存储系统中的元数据集群的子集,以形成元数据集群的数量。 发布将文件的元数据存储在分布式存储系统中的元数据集群上的请求,其中请求包括将文件的元数据存储在元数据集群的正常数量的仲裁中的至少一个元数据集群上的高优先级请求 优先权请求将元数据存储在剩余的元数据集群中,元数据被存储在元数据集群的数量集中的元数据集群中的至少一个之前被存储在剩余的元数据集群上。

    Hierarchical chunking of objects in a distributed storage system
    7.
    发明授权
    Hierarchical chunking of objects in a distributed storage system 有权
    分布式存储系统中对象的分层分块

    公开(公告)号:US09158472B2

    公开(公告)日:2015-10-13

    申请号:US14142706

    申请日:2013-12-27

    Applicant: Google Inc.

    Abstract: Placement of object replicas in a distributed storage system includes, at a first instance, opening a journal for storage of object chunks. Each journal is associated with a single placement policy. An object is received, which comprises a chunk. The object has a placement policy, and the chunk comprises a plurality of storage blocks. The blocks are stored in a journal that matches the placement policy. Global metadata for the object is stored, which includes a list of chunks for the object. Local metadata for the chunk is stored, which includes a block list identifying each block of the plurality of blocks. The local metadata is associated with the journal. The journal is later closed. The journal is subsequently replicated to a second instance according to the placement policy. The global metadata is updated to reflect the replication, whereas the local metadata is unchanged by the replication.

    Abstract translation: 在分布式存储系统中放置对象副本包括首先打开用于存储对象块的日志。 每个日记帐都与单一的刊登位置政策相关联。 接收到一个包含块的对象。 对象具有放置策略,并且该块包括多个存储块。 这些区块存储在与展示位置策略匹配的日记帐中。 存储对象的全局元数据,其中包含对象的块列表。 存储块的本地元数据,其包括标识多个块的每个块的块列表。 本地元数据与日记相关联。 该杂志以后关闭。 该日记随后根据放置政策复制到第二个实例。 全局元数据被更新以反映复制,而复制的本地元数据不变。

    Adaptive and prioritized replication scheduling in storage clusters
    8.
    发明授权
    Adaptive and prioritized replication scheduling in storage clusters 有权
    存储集群中的自适应和优先级复制调度

    公开(公告)号:US08918555B1

    公开(公告)日:2014-12-23

    申请号:US13669596

    申请日:2012-11-06

    Applicant: Google Inc.

    Abstract: In one implementation, groups of objects may be maintained, each group including one or more objects that are to be replicated at one or more of the storage clusters. The objects may be assigned to the groups based on replication choices where at least some of the objects are assigned to multiple ones of the groups. A priority value may be determined and associated with each of the groups, the priority value of a particular group being determined based on priority values associated with objects within the particular group. The objects may be selected, for replication, in a replication order based on the priority value of the groups and replication of the selected objects may be initiated.

    Abstract translation: 在一个实现中,可以维护对象组,每个组包括要在一个或多个存储集群中复制的一个或多个对象。 可以基于复制选择将对象分配给组,其中至少一些对象被分配给多个组。 可以确定优先级值并与每个组相关联,基于与特定组内的对象相关联的优先级值来确定特定组的优先级值。 可以基于组的优先级值以复制顺序来选择对象进行复制,并且可以启动所选对象的复制。

    Categorization for constraint-based placement of object replicas in a distributed storage system

    公开(公告)号:US09659080B1

    公开(公告)日:2017-05-23

    申请号:US13873132

    申请日:2013-04-29

    Applicant: Google Inc.

    CPC classification number: G06F17/30215 G06F17/30575 H04L67/1095

    Abstract: A location assignment daemon (LAD) manages placement of object replicas in a distributed storage system. The distributed storage system may include a plurality of instances, which may be at distinct geographic locations. The LAD determines placement categories for objects stored in the distributed storage system. A placement category for an object corresponds to the object's placement policy and current replica locations. There are substantially fewer placement categories than objects. The LAD determines an action plan for each placement category whose associated objects require either creation or removal of object replicas. Each action plan includes either creating or removing an object replica. The LAD prioritizes the action plans and implements at least a subset of the action plans in priority order in accordance with available resources in the distributed storage system. Each action plan is applied to objects in the placement category corresponding to the action plan.

Patent Agency Ranking