Alternate Path μ-op Cache Prefetching - Techniques of Informatics and Microelectronics for integrated systems Architecture
Communication Dans Un Congrès Année : 2024

Alternate Path μ-op Cache Prefetching

Arthur Perais

Résumé

Datacenter applications are well-known for their large code footprints. This has caused frontend design to evolve by implementing decoupled fetching and large prediction structures - branch predictors, Branch Target Buffers (BTBs) - to mitigate the stagnating size of the instruction cache by prefetching instructions well in advance. In addition, many designs feature a micro operation (μ-op) cache, which primarily provides power savings by bypassing the instruction cache and decoders once warmed up. However, this μ-op cache often has lower reach than the instruction cache, and it is not filled up speculatively using the decoupled fetcher. As a result, the μ-op cache is often over-subscribed by datacenter applications, up to the point of becoming a burden. This paper first shows that because of this pressure, blindly prefetching into the μ-op cache using state-of-the-art standalone prefetchers would not provide significant gains. As a consequence, this paper proposes to prefetch only critical μ-ops into the μ op cache, by focusing on execution points where the μ-op cache provides the most gains: Pipeline refills. Concretely, we use hardto-predict conditional branches as indicators that a pipeline refill is likely to happen in the near future, and prefetch into the μ-op cache the μ-ops that belong to the path opposed to the predicted path, which we call alternate path. Identifying hard-to-predict branches requires no additional state if the branch predictor confidence is used to classify branches. Including extra alternate branch predictors with limited budget (8.95 KB to 12.95 KB), our proposal provides average speedups of 1.9% to 2% and as high as 12% on a subset of CVP-1 traces.

Fichier principal
Vignette du fichier
ISCA_2024-preprint.pdf (552.33 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04675260 , version 1 (26-08-2024)

Licence

Identifiants

Citer

Sawan Singh, Arthur Perais, Alexandra Jimborean, Alberto Ros. Alternate Path μ-op Cache Prefetching. ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA 2024), IEEE; ACM, Jun 2024, Buenos Aires, Argentina. pp.1230-1245, ⟨10.1109/ISCA59077.2024.00092⟩. ⟨hal-04675260⟩

Collections

UGA CNRS TIMA
33 Consultations
39 Téléchargements

Altmetric

Partager

More