公开(公告)号：US11537516B1

公开(公告)日：2022-12-27

申请号：US17491004

申请日：2021-09-30

Applicant: Amazon Technologies, Inc.

Inventor： Tyler Michael Jung ,  Slavcho Georgiev Slavchev ,  Nishant Jain ,  Vishwas Narendra ,  Nikhil Shah ,  James Zuber ,  Sameer Choudhary ,  Christopher A. Stephens ,  Suchindra Yogendra Agarwal ,  Phillip H. Pruett

IPC: G06F12/08 ,  G06F12/0802

Abstract: Systems and methods are provided for using a distributed cache architecture with different methods to load balance requests depending upon whether a requested data item is a freely-requested item (e.g., a “hot key”). The cache may be implemented as a consistent hash ring, and most keys may be assigned to particular node based on a consistent hash. For hot key requests, the requests may be distributed among a subset of nodes rather than being assigned to a specific node using consistent hashing. When a witness service is used to ensure that cached data is fresh, verification requests for data regarding hot keys may be batched to avoid overloading the witness service with hot key requests.

公开(公告)号：US10664508B1

公开(公告)日：2020-05-26

申请号：US15952806

申请日：2018-04-13

Applicant: Amazon Technologies, Inc.

Inventor： Douglas Stewart Laurence ,  Ning Liao ,  Josef Schiefer ,  Sameer Choudhary ,  Ruiwen Zhao ,  Michael Banfield ,  Fusheng Yuan ,  Kaiwen Qu

IPC: G06F16/00 ,  G06F16/335 ,  G06F16/33 ,  G06F16/30

Abstract: Unstructured data items are stored in an item collection. An access request comprising an input interpretation rule and a filtering criterion is directed to at least a portion of the item collection. Records are extracted from an unstructured data item using the input interpretation rule. A response to the access request is obtained, based at least partly in a determination that one of the records satisfies the filtering criterion.

公开(公告)号：US10650032B1

公开(公告)日：2020-05-12

申请号：US15952787

申请日：2018-04-13

Applicant: Amazon Technologies, Inc.

Inventor： Douglas Stewart Laurence ,  Karmveer Veer Singh ,  Ning Liao ,  Josef Schiefer ,  Michael Banfield ,  Kaiwen Qu ,  Karishma Chawla ,  Fusheng Yuan ,  John Pender ,  Sameer Choudhary ,  Milos Faro ,  Ruiwen Zhao

IPC: G06F16/00 ,  G06F16/335 ,  G06F16/33 ,  G06F16/332 ,  G06F16/30

Abstract: Unstructured data items are stored at an object storage service. A filtering criterion to be used to generate a result set for an access request is determined. A test that can be used to determine, without completing parsing of a record identified in an unstructured data item, whether the record satisfies the filtering criterion is identified. Parsing of a particular record is abandoned in response to determining, using the test, that the record satisfies the filtering criterion. A response to the access request is determined using a subset of records that satisfy the filtering criterion.

公开(公告)号：US12032562B1

公开(公告)日：2024-07-09

申请号：US17491029

申请日：2021-09-30

Applicant: Amazon Technologies, Inc.

Inventor： James Zuber ,  Abhishek Kannan ,  Vishwas Narendra ,  Ernest S. Cohen ,  Bryan T. Wilkinson ,  Sameer Choudhary ,  Phillip H. Pruett ,  Nikhil Shah ,  Wilson Li

IPC: G06F16/23 ,  G06F16/22 ,  H04L67/1097

CPC classification number: G06F16/2386 ,  G06F16/2255 ,  G06F16/235 ,  G06F16/2365 ,  H04L67/1097

Abstract: Systems and methods are provided for efficiently maintaining a transaction sequence witness service to ensure that requests to read data provide consistent results across all storage nodes in a distributed system. Each storage node that stores data in response to a particular update event may first update the transaction sequence witness service with the sequence number for the update event. Thus, any other storage node that services a subsequent request for the data will be able to see, via the transaction sequence witness service, the sequence number that must be available on the storage node to respond to the request.

公开(公告)号：US11741078B1

公开(公告)日：2023-08-29

申请号：US17449597

申请日：2021-09-30

Applicant: Amazon Technologies, Inc.

Inventor： Vishwas Narendra ,  James Zuber ,  Arvinth Ravi ,  Sameer Choudhary ,  Rajesh Sampath ,  Tyler Michael Jung ,  Nicholas Jacob Essenburg ,  Phillip H. Pruett ,  Prathiban Mohanasundaram ,  Nishant Jain ,  Suchindra Yogendra Agarwal ,  David Grant Emeny-Smith ,  Hardik Navin Nagda ,  Bryan T. Wilkinson ,  Liming Ye ,  Janko Jerinic ,  Vijayasarathy Kannan ,  Pierre Vigneras ,  Nikhil Shah

IPC: G06F15/16 ,  G06F16/23 ,  G06F16/22 ,  G06F16/27 ,  G06F16/2455

CPC classification number: G06F16/2365 ,  G06F16/2255 ,  G06F16/2358 ,  G06F16/24552 ,  G06F16/27

Abstract: Systems and methods are provided for efficiently maintaining a transaction sequence witness service to ensure that requests to read data provide consistent results across all storage nodes in a distributed system. When a storage node receives a request for a data object, the node may obtain—from transaction sequence witness service—the latest sequence number associated with the object. If the sequence number indicates the object has been modified in the period of time since the currently stored version was stored, the node can obtain the current version from persistent storage.

公开(公告)号：US11640240B1

公开(公告)日：2023-05-02

申请号：US17449625

申请日：2021-09-30

Applicant: Amazon Technologies, Inc.

Inventor： Vishwas Narendra ,  John Pender ,  James Zuber ,  RaghuKishore Balivada ,  Mehak Mehta ,  Harishkumar Katagal ,  Preetham Kowshik ,  Addison Joseph Burns ,  Sameer Choudhary ,  Ernest S. Cohen ,  Abhishek Kannan ,  Arvinth Ravi ,  Nikhil Shah

IPC: G06F12/02 ,  G06F12/06 ,  G06F3/06 ,  G06F1/14

Abstract: Systems and methods are provided for managing the order of data written to a transaction log in a distributed storage system. In a system with multiple nodes, if sequencers are naively generated without taking into consideration inconsistencies among the different nodes generating the sequencers, then the sequencers may not increase for each data transaction. To alleviate this problem, the node committing the transaction to the transaction log may perform a consistent read and verifies that the sequencer advances. If the sequencer does not advance, the node can perform a context-dependent operation such as adjusting the sequencer, acknowledging the write without committing it to the transaction log, or rejecting the write altogether.