公开(公告)号：US11537516B1

公开(公告)日：2022-12-27

申请号：US17491004

申请日：2021-09-30

Applicant: Amazon Technologies, Inc.

Inventor： Tyler Michael Jung ,  Slavcho Georgiev Slavchev ,  Nishant Jain ,  Vishwas Narendra ,  Nikhil Shah ,  James Zuber ,  Sameer Choudhary ,  Christopher A. Stephens ,  Suchindra Yogendra Agarwal ,  Phillip H. Pruett

IPC: G06F12/08 ,  G06F12/0802

Abstract: Systems and methods are provided for using a distributed cache architecture with different methods to load balance requests depending upon whether a requested data item is a freely-requested item (e.g., a “hot key”). The cache may be implemented as a consistent hash ring, and most keys may be assigned to particular node based on a consistent hash. For hot key requests, the requests may be distributed among a subset of nodes rather than being assigned to a specific node using consistent hashing. When a witness service is used to ensure that cached data is fresh, verification requests for data regarding hot keys may be batched to avoid overloading the witness service with hot key requests.