METHOD OF OPERATING DISAGGREGATED MEMORY SYSTEM FOR CONTEXT-AWARE PREFETCH AND DISAGGREGATED MEMORY SYSTEM PREFORMING THE SAME

    公开(公告)号:US20230153245A1

    公开(公告)日:2023-05-18

    申请号:US17865637

    申请日:2022-07-15

    发明人: Insoon JO

    IPC分类号: G06F12/0862

    摘要: A method of operating a disaggregated memory system includes receiving memory management requests from a host device, the memory management requests including context values having different values for plural workloads. The context values are transmitted to an accelerator memory including memory regions to set the context values for the memory regions based on the memory management requests. Prefetch target data is determined based on a context table and a memory access log, and prefetch information associated with the prefetch target data is transmitted to the accelerator memory. The context table includes the context values, and the memory access log is associated with the accelerator memory. The prefetch information is stored in a prefetch target buffer included in the accelerator memory.

    CACHE SECTOR USAGE PREDICTION
    8.
    发明申请

    公开(公告)号:US20180232313A1

    公开(公告)日:2018-08-16

    申请号:US15882104

    申请日:2018-01-29

    申请人: ARM Limited

    摘要: A system cache and method of operating a system cache are provided. The system cache provides data caching in response to data access requests from plural system components. The system cache has data caching storage with plural entries, each entry storing a block of data items and each block of data items comprising plural sectors of data items, and each block of data items being stored in an entry of the data caching storage with an associated address portion. Sector use prediction circuitry is provided which has a set of pattern entries to store a set of sector use patterns. In response to a data access request received from a system component specifying one or more data items a selected pattern entry is selected in dependence on a system component identifier in the data access request and a sector use prediction is generated in dependence on a sector use pattern in the selected pattern entry. Further data items may then be retrieved which are not specified in the data access request but are indicated by the sector use prediction, and memory bandwidth usage is thereby improved.

    Managing memory access requests with prefetch for streams

    公开(公告)号:US10013357B2

    公开(公告)日:2018-07-03

    申请号:US15269072

    申请日:2016-09-19

    申请人: Cavium, Inc.

    摘要: Managing memory access requests to a cache system including one or more cache levels that are configured to store cache lines that correspond to memory blocks in a main memory includes: storing stream information identifying recognized streams that were recognized based on previously received memory access requests, where one or more of the recognized streams comprise strided streams that each have an associated strided prefetch result corresponding to a stride that is larger than or equal to a size of a single cache line; and determining whether or not a next cache line prefetch request corresponding to a particular memory access request will be made based at least in part on whether or not the particular memory access request matches a strided prefetch result for at least one strided stream, and a history of past next cache line prefetch requests.