公开(公告)号：US09659038B2

公开(公告)日：2017-05-23

申请号：US13909029

申请日：2013-06-03

Applicant: Google Inc.

Inventor： Yasushi Saito ,  Sanjay Ghemawat ,  Sebastian Kanthak ,  Christopher Cunningham Frost

IPC: G06F7/00 ,  G06F17/00 ,  G06F17/30

CPC classification number: G06F17/30289 ,  G06F17/30067 ,  G06F17/30575

Abstract: A computer system issues a batch read operation to a tablet in a first replication group in a distributed database and obtains a most recent version of data items in the tablet that have a timestamp no great than a snapshot timestamp T. For each data item in the one tablet, the computer system determines whether the data item has a move-in timestamp less than or equal to the snapshot timestamp T, which is less than a move-out timestamp, and whether the data item has a creation timestamp less than the snapshot timestamp T, which is less than or equal to a deletion timestamp. If the determination is true, the computer system determines whether the move-out timestamp has an actual associated value and, if so, the computer system determines a second tablet in a second replication group in the database that includes the data item and issues the snapshot read operation to the second table in the second replication group to obtain a most-recent version of the data item that has a timestamp no greater than the snapshot timestamp T; otherwise, the computer system issues the snapshot read to the one tablet to obtain a most recent version of the data item that has a timestamp no greater than the snapshot timestamp T.

公开(公告)号：US20130346540A1

公开(公告)日：2013-12-26

申请号：US13899495

申请日：2013-05-21

Applicant: Google Inc.

Inventor： Jeffrey Adgate Dean ,  Sanjay Ghemawat ,  Yasushi Saito ,  Andrew Fikes ,  Christopher Jorgen Taylor ,  Sean Quinlan ,  Michal Piotr Szymaniak ,  Sebastian Kanthak ,  Wilson Cheng-Yi Hsieh ,  Alexander Lloyd ,  Michael James Boyer Epstein

IPC: H04L29/08

CPC classification number: H04L67/1097

Abstract: A system, computer-readable storage medium storing at least one program, and a computer-implemented method for identifying a storage group in a distributed storage system into which data is to be stored is presented. A data structure including information relating to storage groups in a distributed storage system is maintained, where a respective entry in the data structure for a respective storage group includes placement metrics for the respective storage group. A request to identify a storage group into which data is to be stored is received from a computer system. The data structure is used to determine an identifier for a storage group whose placement metrics satisfy a selection criterion. The identifier for the storage group whose placement metrics satisfy the selection criterion is returned to the computer system.

Abstract translation: 呈现存储至少一个程序的系统，计算机可读存储介质和用于识别要存储数据的分布式存储系统中的存储组的计算机实现的方法。 维护包括与分布式存储系统中的存储组有关的信息的数据结构，其中相应存储组的数据结构中的相应条目包括各个存储组的布局度量。 从计算机系统接收到识别要存储数据的存储组的请求。 数据结构用于确定其布局度量满足选择标准的存储组的标识符。 其位置指标满足选择标准的存储组的标识符返回给计算机系统。

公开(公告)号：US20130339301A1

公开(公告)日：2013-12-19

申请号：US13909029

申请日：2013-06-03

Applicant: Google Inc.

Inventor： Yasushi Saito ,  Sanjay Ghemawat ,  Sebastian Kanthak ,  Christopher Cunningham Frost

IPC: G06F17/30

CPC classification number: G06F17/30289 ,  G06F17/30067 ,  G06F17/30575

Abstract: A computer system issues a batch read operation to a tablet in a first replication group in a distributed database and obtains a most recent version of data items in the tablet that have a timestamp no great than a snapshot timestamp T. For each data item in the one tablet, the computer system determines whether the data item has a move-in timestamp less than or equal to the snapshot timestamp T, which is less than a move-out timestamp, and whether the data item has a creation timestamp less than the snapshot timestamp T, which is less than or equal to a deletion timestamp. If the determination is true, the computer system determines whether the move-out timestamp has an actual associated value and, if so, the computer system determines a second tablet in a second replication group in the database that includes the data item and issues the snapshot read operation to the second table in the second replication group to obtain a most-recent version of the data item that has a timestamp no greater than the snapshot timestamp T; otherwise, the computer system issues the snapshot read to the one tablet to obtain a most recent version of the data item that has a timestamp no greater than the snapshot timestamp T.

Abstract translation: 计算机系统向分布式数据库中的第一复制组中的平板电脑发出批量读取操作，并获得平板电脑中具有不大于快照时间戳T的时间戳的最新版本的数据项。对于 一个平板电脑，计算机系统确定数据项是否具有小于或等于快照时间戳T的移入时间戳，小于移出时间戳，以及数据项是否具有小于快照的创建时间戳 时间戳T，小于或等于删除时间戳。 如果确定为真，则计算机系统确定移出时间戳是否具有实际相关联的值，如果是，则计算机系统确定数据库中包括数据项的第二复制组中的第二个平板电脑并发布快照 读操作到第二复制组中的第二表以获得具有不大于快照时间戳T的时间戳的数据项的最新版本; 否则，计算机系统将快照读取发送到一个平板电脑以获得具有不大于快照时间戳T的时间戳的数据项的最新版本。

公开(公告)号：US09774676B2

公开(公告)日：2017-09-26

申请号：US13899495

申请日：2013-05-21

Applicant: Google Inc.

Inventor： Jeffrey Adgate Dean ,  Sanjay Ghemawat ,  Yasushi Saito ,  Andrew Fikes ,  Christopher Jorgen Taylor ,  Sean Quinlan ,  Michal Piotr Szymaniak ,  Sebastian Kanthak ,  Wilson Cheng-Yi Hsieh ,  Alexander Lloyd ,  Michael James Boyer Epstein

IPC: G06F13/00 ,  H04L29/08

CPC classification number: H04L67/1097

Abstract: A system, computer-readable storage medium storing at least one program, and a computer-implemented method for identifying a storage group in a distributed storage system into which data is to be stored is presented. A data structure including information relating to storage groups in a distributed storage system is maintained, where a respective entry in the data structure for a respective storage group includes placement metrics for the respective storage group. A request to identify a storage group into which data is to be stored is received from a computer system. The data structure is used to determine an identifier for a storage group whose placement metrics satisfy a selection criterion. The identifier for the storage group whose placement metrics satisfy the selection criterion is returned to the computer system.

公开(公告)号：US09449006B2

公开(公告)日：2016-09-20

申请号：US13909021

申请日：2013-06-03

Applicant: Google Inc.

Inventor： Yasushi Saito ,  Sanjay Ghemawat ,  Jeffrey Adgate Dean

IPC: G06F17/30

CPC classification number: G06F17/30117 ,  G06F17/3007 ,  G06F17/30156 ,  G06F17/30194 ,  G06F17/30303

Abstract: A method for deleting obsolete files from a file system is provided. The method includes: receiving a request to delete a reference to a target file in a file system from a file reference data structure, wherein the file reference data structure includes target file names and reference file names; identifying a reference file name in the file reference data structure, wherein the reference file name includes a file name of the target file; deleting a reference file from the file system, wherein the reference file has the identified reference file name; checking whether the file system includes at least one reference file whose file name matches the file name of the target file; if there is no such reference file in the file system: deleting the target file from the file system; and deleting the file name of the target file from the file reference data structure.

Abstract translation: 提供了从文件系统中删除过时文件的方法。 该方法包括：从文件参考数据结构接收删除对文件系统中的目标文件的引用的请求，其中文件参考数据结构包括目标文件名和参考文件名; 在所述文件参考数据结构中识别参考文件名，其中所述参考文件名包括所述目标文件的文件名; 从所述文件系统中删除参考文件，其中所述参考文件具有所识别的参考文件名; 检查文件系统是否包含至少一个文件名与目标文件的文件名匹配的引用文件; 如果文件系统中没有这样的引用文件：从文件系统中删除目标文件; 并从文件引用数据结构中删除目标文件的文件名。

公开(公告)号：US20130339318A1

公开(公告)日：2013-12-19

申请号：US13909021

申请日：2013-06-03

Applicant: Google Inc.

Inventor： Yasushi Saito ,  Sanjay Ghemawat ,  Jeffrey Adgate Dean

IPC: G06F17/30

CPC classification number: G06F17/30117 ,  G06F17/3007 ,  G06F17/30156 ,  G06F17/30194 ,  G06F17/30303

Abstract: A method for deleting obsolete files from a file system is provided. The method includes: receiving a request to delete a reference to a target file in a file system from a file reference data structure, wherein the file reference data structure includes target file names and reference file names; identifying a reference file name in the file reference data structure, wherein the reference file name includes a file name of the target file; deleting a reference file from the file system, wherein the reference file has the identified reference file name; checking whether the file system includes at least one reference file whose file name matches the file name of the target file; if there is no such reference file in the file system: deleting the target file from the file system; and deleting the file name of the target file from the file reference data structure.

Abstract translation: 提供了从文件系统中删除过时文件的方法。 该方法包括：从文件参考数据结构接收删除对文件系统中的目标文件的引用的请求，其中文件参考数据结构包括目标文件名和参考文件名; 在所述文件参考数据结构中识别参考文件名，其中所述参考文件名包括所述目标文件的文件名; 从所述文件系统中删除参考文件，其中所述参考文件具有所识别的参考文件名; 检查文件系统是否包含至少一个文件名与目标文件的文件名匹配的引用文件; 如果文件系统中没有这样的引用文件：从文件系统中删除目标文件; 并从文件引用数据结构中删除目标文件的文件名。

公开(公告)号：US09870371B2

公开(公告)日：2018-01-16

申请号：US13938126

申请日：2013-07-09

Applicant: Google Inc.

Inventor： Jeffrey A. Dean ,  Sanjay Ghemawat ,  Andrew B. Fikes ,  Yasushi Saito

IPC: G06F17/30 ,  G06F9/50

CPC classification number: G06F17/30194 ,  G06F9/5083 ,  G06F17/30212 ,  G06F17/30312

Abstract: A method of accessing data includes storing a table that includes a plurality of tablets corresponding to distinct non-overlapping table portions. Respective pluralities of tablet access objects and application objects are stored in a plurality of servers. A distinct application object and distinct tablet are associated with each tablet access object. Each application object corresponds to a distinct instantiation of an application associated with the table. The tablet access objects and associated application objects are redistributed among the servers in accordance with a first load-balancing criterion. A first request directed to a respective tablet is received from a client. In response, the tablet access object associated with the respective tablet is used to perform a data access operation on the respective tablet, and the application object associated with the respective tablet is used to perform an additional computational operation to produce a result to be returned to the client.

公开(公告)号：US20170011056A1

公开(公告)日：2017-01-12

申请号：US15269788

申请日：2016-09-19

Applicant: GOOGLE INC.

Inventor： Yasushi Saito ,  Sanjay Ghemawat ,  Jeffrey Adgate Dean

IPC: G06F17/30

CPC classification number: G06F17/30117 ,  G06F17/3007 ,  G06F17/30156 ,  G06F17/30194 ,  G06F17/30303

Abstract: A method for deleting obsolete files from a file system is provided. The method includes receiving a request to delete a reference to a first target file of a plurality of target files stored in a file system, the first target file having a first target file name. A first reference file whose file name includes the first target file name is identified. The first reference file is deleted from the file system. The method further includes determining whether the file system includes at least one reference file, distinct from the first reference file, whose file name includes the first target file name. In accordance with a determination that the file system does not include the at least one reference file, the first target file is deleted from the file system.

Abstract translation: 提供了从文件系统中删除过时文件的方法。 所述方法包括接收删除对存储在文件系统中的多个目标文件的第一目标文件的引用的请求，所述第一目标文件具有第一目标文件名。 识别文件名包括第一个目标文件名的第一个引用文件。 第一个参考文件从文件系统中删除。 该方法还包括确定文件系统是否包括与第一参考文件不同的至少一个参考文件，其文件名包括第一目标文件名。 根据文件系统不包括至少一个参考文件的确定，从文件系统中删除第一目标文件。

公开(公告)号：US20130297592A1

公开(公告)日：2013-11-07

申请号：US13938126

申请日：2013-07-09

Applicant: Google Inc.

Inventor： Jeffrey A. Dean ,  Sanjay Ghemawat ,  Andrew B. Fikes ,  Yasushi Saito

IPC: G06F17/30

CPC classification number: G06F17/30194 ,  G06F9/5083 ,  G06F17/30212 ,  G06F17/30312

Abstract: A method of accessing data includes storing a table that includes a plurality of tablets corresponding to distinct non-overlapping table portions. Respective pluralities of tablet access objects and application objects are stored in a plurality of servers. A distinct application object and distinct tablet are associated with each tablet access object. Each application object corresponds to a distinct instantiation of an application associated with the table. The tablet access objects and associated application objects are redistributed among the servers in accordance with a first load-balancing criterion. A first request directed to a respective tablet is received from a client. In response, the tablet access object associated with the respective tablet is used to perform a data access operation on the respective tablet, and the application object associated with the respective tablet is used to perform an additional computational operation to produce a result to be returned to the client.

Abstract translation: 访问数据的方法包括存储包括对应于不同的非重叠表部分的多个片的表。 平板电脑访问对象和应用对象的多个存储在多个服务器中。 独特的应用对象和不同的平板电脑与每个平板电脑访问对象相关联。 每个应用程序对象对应于与该表相关联的应用程序的不同实例。 平板电脑访问对象和关联的应用程序对象根据第一个负载平衡标准在服务器之间重新分配。 从客户端接收到针对相应平板电脑的第一请求。 作为响应，与各个平板电脑相关联的平板电脑访问对象被用于在相应的平板电脑上执行数据访问操作，并且使用与各个平板电脑相关联的应用对象来执行附加的计算操作以产生要返回到 客户端。