-
公开(公告)号:US20230409597A1
公开(公告)日:2023-12-21
申请号:US18181414
申请日:2023-03-09
发明人: Satish Kumar Kashi Visvanathan , Vikram Singh Bisht , Viggnesh Venugopal , Ravi Lingappa Shamanna
IPC分类号: G06F16/27
CPC分类号: G06F16/27
摘要: Techniques are described for partitioning B-tree keys of file systems into key ranges for parallel processing in delta generation during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, a delta generation processing for cross-region replication may utilize a key-range splitting mechanism involving a recursive algorithm that partitions B-tree keys of a source file system into roughly equal-size key ranges. All the partitioned key ranges may be processed in parallel and concurrently by different processing threads, one thread per key range, to improve the performance of the delta generation and achieve scalability.
-
公开(公告)号:US20230409442A1
公开(公告)日:2023-12-21
申请号:US18304226
申请日:2023-04-20
发明人: Satish Kumar Kashi Visvanathan , Viggnesh Venugopal , Victor Vladimir Golosovker , Ravi Lingappa Shamanna
CPC分类号: G06F11/1464 , G06F11/1451 , G06F16/2246 , G06F2201/84
摘要: Techniques are described for maintaining data consistency when failure events occur during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, two generation numbers (or different identifications) are assigned to two groups of processed B-tree key-value pairs, one before and one after a failure event, within a key range. In some embodiments, the two generation numbers are assigned to a group of B-tree key-value pairs processed by a failed thread and another group of B-tree key-value pairs processed by a substitute thread taking over the failed thread to avoid potential data corruption.
-
公开(公告)号:US12001404B2
公开(公告)日:2024-06-04
申请号:US18304161
申请日:2023-04-20
发明人: Satish Kumar Kashi Visvanathan , Viggnesh Venugopal , Victor Vladimir Golosovker , Ravi Lingappa Shamanna
IPC分类号: G06F16/182 , G06F9/50 , G06F11/14 , G06F11/20 , G06F16/11 , G06F16/174 , G06F16/176 , G06F16/178 , G06F16/185 , G06F16/22 , G06F16/23 , G06F16/27 , G06F21/60 , G06F21/62 , H04L9/08 , H04L9/14 , H04L9/32
CPC分类号: G06F16/1844 , G06F9/505 , G06F11/1417 , G06F11/1451 , G06F11/1464 , G06F11/2023 , G06F11/2028 , G06F16/128 , G06F16/1756 , G06F16/1774 , G06F16/178 , G06F16/185 , G06F16/2246 , G06F16/2365 , G06F16/27 , G06F21/602 , G06F21/6218 , H04L9/0819 , H04L9/14 , H04L9/3228 , G06F2201/84
摘要: Techniques are described for checkpointing multiple key ranges in parallel and concurrently during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, multiple range threads processing multiple key ranges, one thread per key range, create checkpoints for their respective key ranges in parallel and concurrently after processing a per-determined number of B-tree keys. In certain embodiments, each thread requests a lock from a central checkpoint record and takes turns for updating a status byte while continuing processing the B-tree keys in its responsible key range. In certain embodiments, upon encountering a failure event, either a system crash or a thread failure, each thread restarts its B-tree key processing from a B-tree key after the most recent checkpoint.
-
公开(公告)号:US20230409534A1
公开(公告)日:2023-12-21
申请号:US18304161
申请日:2023-04-20
发明人: Satish Kumar Kashi Visvanathan , Viggnesh Venugopal , Victor Vladimir Golosovker , Ravi Lingappa Shamanna
IPC分类号: G06F16/178 , G06F16/176 , G06F16/185
CPC分类号: G06F16/178 , G06F16/1774 , G06F16/185
摘要: Techniques are described for checkpointing multiple key ranges in parallel and concurrently during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, multiple range threads processing multiple key ranges, one thread per key range, create checkpoints for their respective key ranges in parallel and concurrently after processing a per-determined number of B-tree keys. In certain embodiments, each thread requests a lock from a central checkpoint record and takes turns for updating a status byte while continuing processing the B-tree keys in its responsible key range. In certain embodiments, upon encountering a failure event, either a system crash or a thread failure, each thread restarts its B-tree key processing from a B-tree key after the most recent checkpoint.
-
公开(公告)号:US20240281413A1
公开(公告)日:2024-08-22
申请号:US18646676
申请日:2024-04-25
发明人: Satish Kumar Kashi Visvanathan , Viggnesh Venugopal , Victor Vladimir Golosovker , Ravi Lingappa Shamanna
IPC分类号: G06F16/182 , G06F9/50 , G06F11/14 , G06F11/20 , G06F16/11 , G06F16/174 , G06F16/176 , G06F16/178 , G06F16/185 , G06F16/22 , G06F16/23 , G06F16/27 , G06F21/60 , G06F21/62 , H04L9/08 , H04L9/14 , H04L9/32
CPC分类号: G06F16/1844 , G06F9/505 , G06F11/1417 , G06F11/1451 , G06F11/1464 , G06F11/2023 , G06F11/2028 , G06F16/128 , G06F16/1756 , G06F16/1774 , G06F16/178 , G06F16/185 , G06F16/2246 , G06F16/2365 , G06F16/27 , G06F21/602 , G06F21/6218 , H04L9/0819 , H04L9/14 , H04L9/3228 , G06F2201/84
摘要: Techniques are described for checkpointing multiple key ranges in parallel and concurrently during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, multiple range threads processing multiple key ranges, one thread per key range, create checkpoints for their respective key ranges in parallel and concurrently after processing a per-determined number of B-tree keys. In certain embodiments, upon encountering a failure event, either a system crash or a thread failure, each thread restarts its B-tree key processing from a B-tree key after the most recent checkpoint.
-
公开(公告)号:US20240094937A1
公开(公告)日:2024-03-21
申请号:US18521176
申请日:2023-11-28
IPC分类号: G06F3/06
CPC分类号: G06F3/065 , G06F3/0604 , G06F3/0679
摘要: Techniques are described for enabling concurrent and non-blocking replication object deletion during cross-region replications. In some embodiments, in a target file system, a target replication pipeline as part of a cross-region replication, and a deletion pipeline operate in parallel. The deletion pipeline deletes processed objects reaching the last pipeline stage of the target replication pipeline after each checkpoint in the target replication pipeline. In some embodiments, after a non-recoverable failure during the cross-region replication, the cross-region replication can be restarted from the beginning (i.e., fresh restart) without waiting for its unused objects in the Object Store to be deleted by utilizing a generation number associated with each object to delete the unused objects in a background process while allowing deleting processed objects as normal for the freshly restarted cross-region replication.
-
-
-
-
-