公开(公告)号：US10810157B1

公开(公告)日：2020-10-20

申请号：US15279225

申请日：2016-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Frank Charles Paterra ,  Eric Neilsen ,  Firat Basarir ,  Andrew Portnoy

IPC: G06F16/20 ,  G06F16/13 ,  G06F9/54 ,  G06F16/11 ,  G06F16/16 ,  G06F16/182 ,  G06F16/242 ,  G06F16/14

Abstract: A data storage system implements aggregation, bifurcation, and/or reduction techniques to improve the efficiency of processing data storage requests. Data storage requests and/or their associated payloads may be aggregated based on one or more parameters. Data to be stored and the associated commands may be separated so as to optimize a system's throughput and latency for each. Furthermore, extraneous commands and requests may be reduced or eliminated based on heuristics associated with the requests and the data.

公开(公告)号：US11281624B1

公开(公告)日：2022-03-22

申请号：US15279316

申请日：2016-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Frank Charles Paterra ,  Eric Neilsen ,  Apoorv Birthare ,  Andrew Portnoy ,  Firat Basarir

IPC: G06F16/13 ,  H04L67/01 ,  G06F16/182

Abstract: A data storage system implements aggregation, bifurcation, and/or reduction techniques to improve the efficiency of processing data storage requests. Data storage requests and/or their associated payloads may be aggregated based on one or more parameters. Data to be the stored and the associated commands may be separated so as to optimize a system's throughput and latency for each. Furthermore, extraneous commands and requests may be reduced or eliminated based on heuristics associated with the requests and the data.

公开(公告)号：US10437790B1

公开(公告)日：2019-10-08

申请号：US15279296

申请日：2016-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Frank Charles Paterra ,  Eric Neilsen

IPC: G06F17/00 ,  G06F16/182 ,  H04L29/06 ,  G06F16/13

Abstract: A data storage system implements aggregation, bifurcation, and/or reduction techniques to improve the efficiency of processing data storage requests. Data storage requests and/or their associated payloads may be aggregated based on one or more parameters. Data to be the stored and the associated commands may be separated so as to optimize a system's throughput and latency for each. Furthermore, extraneous commands and requests may be reduced or eliminated based on heuristics associated with the requests and the data.

公开(公告)号：US11561927B1

公开(公告)日：2023-01-24

申请号：US15632810

申请日：2017-06-26

Applicant: Amazon Technologies, Inc.

Inventor： Eric Neilsen ,  Jeffry Strunk ,  Ho Ming Li

IPC: G06F16/11 ,  G06F16/21 ,  G06F16/27

Abstract: Technologies are disclosed for migrating large amounts of data objects, e.g., billions of data objects, from a distributed data store to another data store or computing device. A method includes generating an inventory of the data objects in the distributed data store and dividing the inventory into multiple listings of data objects. Each data object is identified in only one corresponding listing. Manifests are generated based upon the listings. Each manifest is assigned to a corresponding portable storage device of a plurality of portable storage devices, and the data objects and listings are transferred, based at least in part, upon the manifests to the plurality of portable storage devices. The inventory of the data objects and the plurality of portable storage devices are provided to an entity associated with the another data store or computing device. The data objects are transferred from the plurality of portable storage devices to the another data store or computing device using the inventory.

公开(公告)号：US11063915B1

公开(公告)日：2021-07-13

申请号：US15469363

申请日：2017-03-24

Applicant: Amazon Technologies, Inc.

Inventor： Frank Charles Paterra ,  Eric Neilsen ,  Elodie Wun ,  Mahadeva Navali Basavaraj ,  Shuo Yang ,  Vaibhav Tyagi ,  Xiao Li

IPC: H04L29/06 ,  G06F3/06 ,  H04L9/14 ,  H04L9/06 ,  H04L9/32 ,  H04L9/08

Abstract: A device such as a network-attachable data transfer device may be configured to operate in a cluster to coordinate the storage of data. A cluster manifest may include data and/or metadata related to devices of the cluster. In some cases, a cluster manifest may include, for each of one or more devices of a cluster: an encrypted payload; an identifier associated with the particular device; and an encrypted data entry. The encrypted payload may encode a cryptographic payload key used in part to perform storage operations. The encrypted data entry may include one or more encrypted partitions that are each decryptable by a different security module of the device. The decrypted partitions may be assembled to form a cryptographic key that may decrypt the encrypted payload. The cluster manifest may be provided to a locked device of a cluster as part of a process for unlocking the locked device.

公开(公告)号：US10657097B1

公开(公告)日：2020-05-19

申请号：US15279341

申请日：2016-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Frank Charles Paterra ,  Eric Neilsen

IPC: G06F17/30 ,  G06F16/13 ,  G06F16/174

Abstract: A data storage system implements aggregation, bifurcation, and/or reduction techniques to improve the efficiency of processing data storage requests. Data storage requests and/or their associated payloads may be aggregated based on one or more parameters. Data to be the stored and the associated commands may be separated so as to optimize a system's throughput and latency for each. Furthermore, extraneous commands and requests may be reduced or eliminated based on heuristics associated with the requests and the data.

公开(公告)号：US11204895B1

公开(公告)日：2021-12-21

申请号：US15279304

申请日：2016-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Frank Charles Paterra ,  Eric Neilsen

IPC: G06F7/00 ,  G06F17/30 ,  G06F16/16 ,  G06F9/54 ,  G06F16/13

Abstract: A data storage system implements aggregation, bifurcation, and/or reduction techniques to improve the efficiency of processing data storage requests. Data storage requests and/or their associated payloads may be aggregated based on one or more parameters. Data to be the stored and the associated commands may be separated so as to optimize a system's throughput and latency for each. Furthermore, extraneous commands and requests may be reduced or eliminated based on heuristics associated with the requests and the data.

公开(公告)号：US10860533B1

公开(公告)日：2020-12-08

申请号：US15631876

申请日：2017-06-23

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Eric Neilsen ,  Paul David Franklin

IPC: G06F16/14 ,  G06F16/174

Abstract: A processing device receives a request to identify whether a file is a complete file. The processing device determines a first size of the file. The processing device determines whether the first size satisfies a size criterion. The processing device determines that the file is a complete file responsive to the determination that the first size satisfies the size criterion.