公开(公告)号：US11714573B1

公开(公告)日：2023-08-01

申请号：US17216373

申请日：2021-03-29

Applicant: Amazon Technologies, Inc.

Inventor： Shashank Bhardwaj ,  Roman Gavrilov ,  Brian Scott Ross ,  Mehul A. Shah ,  Benjamin Sowell ,  Anthony A. Virtuoso ,  Linan Zheng

IPC: G06F3/06

CPC classification number: G06F3/0659 ,  G06F3/067 ,  G06F3/0613 ,  G06F3/0614 ,  G06F3/0653

Abstract: Techniques for storage optimization in a distributed object store are described. A storage optimization service of a provider network monitors changes to data objects in a distributed object store that are part of a data lake and are referenced by a table index. The storage optimization service determines whether particular storage optimizations involving the data objects would be beneficial, prioritizes the ordering of these optimizations with a focus on performing impactful optimizations first, while intelligently scheduling the optimizations to avoid overutilization of available resources.