公开(公告)号：US10157199B2

公开(公告)日：2018-12-18

申请号：US15286473

申请日：2016-10-05

Applicant: Amazon Technologies, Inc.

Inventor： Kestutis Patiejunas ,  Colin L. Lazier ,  Mark C. Seigle ,  Bryan J. Donlan

IPC: G06F17/30 ,  G06F11/10

Abstract: Embodiments of the present disclosure are directed to, among other things, validating the integrity of received and/or stored data payloads. In some examples, a storage service may perform a first partitioning of a data object into first partitions based at least in part on a first operation. The storage service may also verify the data object, by utilizing a verification algorithm, to generate a first verification value. In some cases, the storage service may additionally perform a second partitioning of the data object into second partitions based at least in part on a second operation. The second partitions may be different from the first partitions. Additionally, the archival data storage service may verify the data object using the verification algorithm to generate a second verification value. Further, the storage service may determine whether the second verification value equals the first verification value.

公开(公告)号：US09535736B2

公开(公告)日：2017-01-03

申请号：US14578148

申请日：2014-12-19

Applicant: Amazon Technologies, Inc.

Inventor： Atle N. Jorgensen ,  Marcin Kowalski ,  Colin L. Lazier

IPC: G06F9/455 ,  G06F9/46 ,  G06F9/50 ,  G06F9/48

CPC classification number: G06F9/45558 ,  G06F9/455 ,  G06F9/4881 ,  G06F9/5038 ,  G06F9/5077 ,  G06F2009/4557 ,  G06F2009/45595 ,  G06F2209/5021 ,  G06F2209/504 ,  Y02D10/22

Abstract: In this disclosure, a resource scheduler is described that allows virtual machine instances to earn resource credits during the low activity levels. Virtual machine instances that spend a predominant amount of time operating at low activity levels are able to quickly gain resource credits. Once these virtual machine instances acquire enough resource credits to surpass a threshold level, the resource scheduler can assign a high priority level to the virtual machine instances that provide them with priority access to CPU resources. The next time that the virtual machine instances enter a high activity level, they have a high priority level that allows them to preempt other, lower priority virtual machine instances. Thus, these virtual machine instances are able to process operations and/or respond to user requests with low latency.

Abstract translation: 在本公开中，描述了允许虚拟机实例在低活动级别期间获得资源信用的资源调度器。 花费大量时间运作在低活动水平的虚拟机实例能够快速获得资源信用。 一旦这些虚拟机实例获得足够的资源信用以超过阈值级别，资源调度器就可以为虚拟机实例分配高优先权级别，从而为其提供对CPU资源的优先访问。 虚拟机实例下一次进入高活动级别时，它们具有高优先级，允许它们抢占其他优先级较低的虚拟机实例。 因此，这些虚拟机实例能够以低延迟处理操作和/或响应用户请求。

公开(公告)号：US20160103870A1

公开(公告)日：2016-04-14

申请号：US14973715

申请日：2015-12-17

Applicant: Amazon Technologies, Inc.

Inventor： Kestutis Patiejunas ,  Christian L. Claiborn ,  Colin L. Lazier ,  Claire E. Suver ,  Mark C. Seigle

IPC: G06F17/30

Abstract: An application programming interface for a data storage service provides a convenient mechanism for clients of the data storage service to access its various capabilities. An API call may be made to initiate a job and in response a job identifier may be provided. A separate API call specifying the job identifier may be made and a response providing information related to the job may result. Various API calls may be used to store data, retrieve data, obtain an inventory of stored data, and to obtain other information relating to stored data.

Abstract translation: 用于数据存储服务的应用编程接口为数据存储服务的客户端提供方便的机制来访问其各种能力。 可以进行API调用以启动作业，并且作为响应，可以提供作业标识符。 可以制定指定作业标识符的单独的API调用，并且可能导致提供与该作业相关的信息的响应。 可以使用各种AP​​I调用来存储数据，检索数据，获取存储的数据的库存，以及获得与存储的数据有关的其他信息。

公开(公告)号：US09281845B1

公开(公告)日：2016-03-08

申请号：US14503221

申请日：2014-09-30

Applicant: Amazon Technologies, Inc.

Inventor： Colin L. Lazier

IPC: H03M13/29 ,  G06F11/10 ,  H03M13/35 ,  G06F3/06

CPC classification number: H03M13/2906 ,  G06F3/0604 ,  G06F11/1076 ,  H03M13/293 ,  H03M13/35 ,  H03M13/373

Abstract: Techniques for optimizing data storage are disclosed herein. In particular, methods and systems for implementing redundancy encoding schemes with data storage systems are described. The redundancy encoding schemes may be scheduled according to system and data characteristics. The schemes may span multiple tiers or layers of a storage system. The schemes may be generated, for example, in accordance with a transaction rate requirement, a data durability requirement or in the context of the age of the stored data. The schemes may be designed to rectify entropy-related effects upon data storage. The schemes may include one or more erasure codes or erasure coding schemes. Additionally, methods and systems for improving and/or accounting for failure correlation of various components of the storage system, including that of storage devices such as hard disk drives, are described.

Abstract translation: 本文公开了用于优化数据存储的技术。 特别地，描述了用于实现具有数据存储系统的冗余编码方案的方法和系统。 可以根据系统和数据特性调度冗余编码方案。 这些方案可以跨越存储系统的多层或多层。 可以例如根据交易速率要求，数据持久性要求或者存储数据的年龄的上下文来生成这些方案。 这些方案可能被设计为纠正数据存储时的熵相关影响。 这些方案可以包括一个或多个擦除代码或擦除编码方案。 此外，描述了用于改进和/或计算存储系统的各种组件（包括诸如硬盘驱动器）的存储设备的故障相关性的方法和系统。