公开(公告)号：US20220066947A1

公开(公告)日：2022-03-03

申请号：US17008457

申请日：2020-08-31

Applicant: Apple Inc.

Inventor： John D. Pape ,  Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/1027

Abstract: Systems, apparatuses, and methods for implementing translation lookaside buffer (TLB) striping to enable efficient invalidation operations are described. TLB sizes are growing in width (more features in a given page table entry) and depth (to cover larger memory footprints). A striping scheme is proposed to enable an efficient and high performance method for performing TLB maintenance operations in the face of this growth. Accordingly, a TLB stores first attribute data in a striped manner across a plurality of arrays. The striped manner allows different entries to be searched simultaneously in response to receiving an invalidation request which identifies a particular attribute of a group to be invalidated. Upon receiving an invalidation request, the TLB generates a plurality of indices with an offset between each index and walks through the plurality of arrays by incrementing each index and simultaneously checking the first attribute data in corresponding entries.

公开(公告)号：US11429535B1

公开(公告)日：2022-08-30

申请号：US17372356

申请日：2021-07-09

Applicant: Apple Inc.

Inventor： Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/1009 ,  G06F12/1027 ,  G06F12/02 ,  G06F12/0817 ,  G06F12/128 ,  G06F12/0811

Abstract: Techniques are disclosed relating to controlling cache replacement. In some embodiments, search control circuitry is configured to perform multiple searches of a data structure (e.g., page table walks) where searches traverse multiple links between elements of the data structure. In some embodiments, a traversal cache caches traversal information that is usable by searches to skip one or more links traversed by one or more prior searches. In some embodiments, tracking control circuitry stores tracking information in a first entry, where the tracking information indicates a location in the traversal cache at which prior traversal information for a first search is stored. In some embodiments, replacement control circuitry selects, based on the tracking information in the first entry of the tracking control circuitry, an entry in the traversal cache for new traversal information generated by the first search (which may include selecting the first entry to override a default replacement policy).

公开(公告)号：US12079140B2

公开(公告)日：2024-09-03

申请号：US18189982

申请日：2023-03-24

Applicant: Apple Inc.

Inventor： John D. Pape ,  Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/1027 ,  G06F9/455

CPC classification number: G06F12/1027 ,  G06F9/45558 ,  G06F2009/45583 ,  G06F2212/683

Abstract: Systems, apparatuses, and methods for performing efficient translation lookaside buffer (TLB) invalidation operations for splintered pages are described. When a TLB receives an invalidation request for a specified translation context, and the invalidation request maps to an entry with a relatively large page size, the TLB does not know if there are multiple translation entries stored in the TLB for smaller splintered pages of the relatively large page. The TLB tracks whether or not splintered pages for each translation context have been installed. If a TLB invalidate (TLBI) request is received, and splintered pages have not been installed, no searches are needed for splintered pages. To refresh the sticky bits, whenever a full TLB search is performed, the TLB rescans for splintered pages for other translation contexts. If no splintered pages are found, the sticky bit can be cleared and the number of full TLBI searches is reduced.

公开(公告)号：US11720501B2

公开(公告)日：2023-08-08

申请号：US17817748

申请日：2022-08-05

Applicant: Apple Inc.

Inventor： Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/1009 ,  G06F12/1027 ,  G06F12/02 ,  G06F12/0817 ,  G06F12/128 ,  G06F12/0811 ,  G06F12/0802

CPC classification number: G06F12/1009 ,  G06F12/0238 ,  G06F12/0802 ,  G06F12/0811 ,  G06F12/0824 ,  G06F12/1027 ,  G06F12/128 ,  G06F2212/60

Abstract: Techniques are disclosed relating to controlling cache replacement. In some embodiments, a computing system performs multiple searches of a data structure, where one or more of the searches traverse multiple links between elements of the data structure. The system may cache, in a traversal cache, traversal information that is usable by searches to skip one or more links traversed by one or more prior searches. The system may store tracking information that indicates a location in the traversal cache at which prior traversal information for a first search is stored. The system may select, based on the tracking information, an entry in the traversal cache for new traversal information generated by the first search. The selection may override a default replacement policy for the traversal cache, e.g., to select the location in the traversal cache to replace the prior traversal information with the new traversal information.

公开(公告)号：US20230236988A1

公开(公告)日：2023-07-27

申请号：US18189982

申请日：2023-03-24

Applicant: Apple Inc.

Inventor： John D. Pape ,  Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/1027 ,  G06F9/455

CPC classification number: G06F12/1027 ,  G06F9/45558 ,  G06F2212/683 ,  G06F2009/45583

Abstract: Systems, apparatuses, and methods for performing efficient translation lookaside buffer (TLB) invalidation operations for splintered pages are described. When a TLB receives an invalidation request for a specified translation context, and the invalidation request maps to an entry with a relatively large page size, the TLB does not know if there are multiple translation entries stored in the TLB for smaller splintered pages of the relatively large page. The TLB tracks whether or not splintered pages for each translation context have been installed. If a TLB invalidate (TLBI) request is received, and splintered pages have not been installed, no searches are needed for splintered pages. To refresh the sticky bits, whenever a full TLB search is performed, the TLB rescans for splintered pages for other translation contexts. If no splintered pages are found, the sticky bit can be cleared and the number of full TLBI searches is reduced.

公开(公告)号：US11675710B2

公开(公告)日：2023-06-13

申请号：US17016179

申请日：2020-09-09

Applicant: Apple Inc.

Inventor： John D. Pape ,  Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/1045 ,  G06F12/0882 ,  G06F9/455 ,  G06F12/1027

CPC classification number: G06F12/1063 ,  G06F9/45558 ,  G06F12/0882 ,  G06F12/1027 ,  G06F2009/45583 ,  G06F2212/7201

Abstract: Systems, apparatuses, and methods for limiting translation lookaside buffer (TLB) searches using active page size are described. A TLB stores virtual-to-physical address translations for a plurality of different page sizes. When the TLB receives a command to invalidate a TLB entry corresponding to a specified virtual address, the TLB performs, for the plurality of different pages sizes, multiple different lookups of the indices corresponding to the specified virtual address. In order to reduce the number of lookups that are performed, the TLB relies on a page size presence vector and an age matrix to determine which page sizes to search for and in which order. The page size presence vector indicates which page sizes may be stored for the specified virtual address. The age matrix stores a preferred search order with the most probable page size first and the least probable page size last.

公开(公告)号：US11615033B2

公开(公告)日：2023-03-28

申请号：US17016229

申请日：2020-09-09

Applicant: Apple Inc.

Inventor： John D. Pape ,  Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/1027 ,  G06F9/455

Abstract: Systems, apparatuses, and methods for performing efficient translation lookaside buffer (TLB) invalidation operations for splintered pages are described. When a TLB receives an invalidation request for a specified translation context, and the invalidation request maps to an entry with a relatively large page size, the TLB does not know if there are multiple translation entries stored in the TLB for smaller splintered pages of the relatively large page. The TLB tracks whether or not splintered pages for each translation context have been installed. If a TLB invalidate (TLBI) request is received, and splintered pages have not been installed, no searches are needed for splintered pages. To refresh the sticky bits, whenever a full TLB search is performed, the TLB rescans for splintered pages for other translation contexts. If no splintered pages are found, the sticky bit can be cleared and the number of full TLBI searches is reduced.

公开(公告)号：US20230012199A1

公开(公告)日：2023-01-12

申请号：US17817748

申请日：2022-08-05

Applicant: Apple Inc.

Inventor： Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/0802

Abstract: Techniques are disclosed relating to controlling cache replacement. In some embodiments, a computing system performs multiple searches of a data structure, where one or more of the searches traverse multiple links between elements of the data structure. The system may cache, in a traversal cache, traversal information that is usable by searche s to skip one or more links traversed by one or more prior searches. The system may store tracking information that indicates a location in the traversal cache at which prior traversal information for a first search is stored. The system may select, based on the tracking information, an entry in the traversal cache for new traversal information generated by the first search. The selection may override a default replacement policy for the traversal cache, e.g., to select the location in the traversal cache to replace the prior traversal information with the new traversal information.

公开(公告)号：US11422946B2

公开(公告)日：2022-08-23

申请号：US17008457

申请日：2020-08-31

Applicant: Apple Inc.

Inventor： John D. Pape ,  Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/10 ,  G06F12/1027

Abstract: Systems, apparatuses, and methods for implementing translation lookaside buffer (TLB) striping to enable efficient invalidation operations are described. TLB sizes are growing in width (more features in a given page table entry) and depth (to cover larger memory footprints). A striping scheme is proposed to enable an efficient and high performance method for performing TLB maintenance operations in the face of this growth. Accordingly, a TLB stores first attribute data in a striped manner across a plurality of arrays. The striped manner allows different entries to be searched simultaneously in response to receiving an invalidation request which identifies a particular attribute of a group to be invalidated. Upon receiving an invalidation request, the TLB generates a plurality of indices with an offset between each index and walks through the plurality of arrays by incrementing each index and simultaneously checking the first attribute data in corresponding entries.

公开(公告)号：US20220075735A1

公开(公告)日：2022-03-10

申请号：US17016179

申请日：2020-09-09

Applicant: Apple Inc.

Inventor： John D. Pape ,  Brian R. Mestan ,  Peter G. Soderquist

IPC: G06F12/1045 ,  G06F12/0882 ,  G06F9/455

Abstract: Systems, apparatuses, and methods for limiting translation lookaside buffer (TLB) searches using active page size are described. A TLB stores virtual-to-physical address translations for a plurality of different page sizes. When the TLB receives a command to invalidate a TLB entry corresponding to a specified virtual address, the TLB performs, for the plurality of different pages sizes, multiple different lookups of the indices corresponding to the specified virtual address. In order to reduce the number of lookups that are performed, the TLB relies on a page size presence vector and an age matrix to determine which page sizes to search for and in which order. The page size presence vector indicates which page sizes may be stored for the specified virtual address. The age matrix stores a preferred search order with the most probable page size first and the least probable page size last.