Going the distance for TLB prefetching

An application-driven study

Gokul B. Kandiraju, Anand Sivasubramaniam

Research output: Contribution to journalConference article

85 Citations (Scopus)

Abstract

The importance of the Translation Lookaside Buffer (TLB) on system performance is well known. There have been numerous prior efforts addressing TLB design issues for Cutting down access times and lowering miss rates. However, it was only recently that the first exploration on prefetching TLB entries ahead of their need was undertaken and a mechanism called Recency Prefetching was proposed. There is a large body of literature on prefetching for caches, and it is not clear how they can be adapted (or if the issues are different) for TLBs, how well suited they are for TLB prefetching, and how they compare with the recency pre fetching mechanism. This paper presents the first detailed comparison of different prefetching mechanisms (previously proposed for caches) - arbitrary stride prefetching, and markov prefetching - for TLB entries, and evaluates their pros and cons. In addition, this paper proposes a novel prefetching mechanism, called Distance Prefetching, that attempts to capture patterns in the reference behavior in a smaller space than earlier proposals. Using detailed simulations of a wide variety of applications (56 in all) from different benchmark suites and all the SPEC CPU2000 applications, this paper demonstrates the benefits of distance prefetching.

Original languageEnglish (US)
Pages (from-to)195-206
Number of pages12
JournalConference Proceedings - Annual International Symposium on Computer Architecture, ISCA
StatePublished - Jan 1 2002
Event29th Annual International Symposium on Computer Architecture - Anchorage, AK, United States
Duration: May 25 2002May 29 2002

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture

Cite this

@article{1cb4a5b51e26466c9b41ae2b8de8823f,
title = "Going the distance for TLB prefetching: An application-driven study",
abstract = "The importance of the Translation Lookaside Buffer (TLB) on system performance is well known. There have been numerous prior efforts addressing TLB design issues for Cutting down access times and lowering miss rates. However, it was only recently that the first exploration on prefetching TLB entries ahead of their need was undertaken and a mechanism called Recency Prefetching was proposed. There is a large body of literature on prefetching for caches, and it is not clear how they can be adapted (or if the issues are different) for TLBs, how well suited they are for TLB prefetching, and how they compare with the recency pre fetching mechanism. This paper presents the first detailed comparison of different prefetching mechanisms (previously proposed for caches) - arbitrary stride prefetching, and markov prefetching - for TLB entries, and evaluates their pros and cons. In addition, this paper proposes a novel prefetching mechanism, called Distance Prefetching, that attempts to capture patterns in the reference behavior in a smaller space than earlier proposals. Using detailed simulations of a wide variety of applications (56 in all) from different benchmark suites and all the SPEC CPU2000 applications, this paper demonstrates the benefits of distance prefetching.",
author = "Kandiraju, {Gokul B.} and Anand Sivasubramaniam",
year = "2002",
month = "1",
day = "1",
language = "English (US)",
pages = "195--206",
journal = "Proceedings - International Symposium on Computer Architecture",
issn = "1063-6897",

}

TY - JOUR

T1 - Going the distance for TLB prefetching

T2 - An application-driven study

AU - Kandiraju, Gokul B.

AU - Sivasubramaniam, Anand

PY - 2002/1/1

Y1 - 2002/1/1

N2 - The importance of the Translation Lookaside Buffer (TLB) on system performance is well known. There have been numerous prior efforts addressing TLB design issues for Cutting down access times and lowering miss rates. However, it was only recently that the first exploration on prefetching TLB entries ahead of their need was undertaken and a mechanism called Recency Prefetching was proposed. There is a large body of literature on prefetching for caches, and it is not clear how they can be adapted (or if the issues are different) for TLBs, how well suited they are for TLB prefetching, and how they compare with the recency pre fetching mechanism. This paper presents the first detailed comparison of different prefetching mechanisms (previously proposed for caches) - arbitrary stride prefetching, and markov prefetching - for TLB entries, and evaluates their pros and cons. In addition, this paper proposes a novel prefetching mechanism, called Distance Prefetching, that attempts to capture patterns in the reference behavior in a smaller space than earlier proposals. Using detailed simulations of a wide variety of applications (56 in all) from different benchmark suites and all the SPEC CPU2000 applications, this paper demonstrates the benefits of distance prefetching.

AB - The importance of the Translation Lookaside Buffer (TLB) on system performance is well known. There have been numerous prior efforts addressing TLB design issues for Cutting down access times and lowering miss rates. However, it was only recently that the first exploration on prefetching TLB entries ahead of their need was undertaken and a mechanism called Recency Prefetching was proposed. There is a large body of literature on prefetching for caches, and it is not clear how they can be adapted (or if the issues are different) for TLBs, how well suited they are for TLB prefetching, and how they compare with the recency pre fetching mechanism. This paper presents the first detailed comparison of different prefetching mechanisms (previously proposed for caches) - arbitrary stride prefetching, and markov prefetching - for TLB entries, and evaluates their pros and cons. In addition, this paper proposes a novel prefetching mechanism, called Distance Prefetching, that attempts to capture patterns in the reference behavior in a smaller space than earlier proposals. Using detailed simulations of a wide variety of applications (56 in all) from different benchmark suites and all the SPEC CPU2000 applications, this paper demonstrates the benefits of distance prefetching.

UR - http://www.scopus.com/inward/record.url?scp=0036287598&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036287598&partnerID=8YFLogxK

M3 - Conference article

SP - 195

EP - 206

JO - Proceedings - International Symposium on Computer Architecture

JF - Proceedings - International Symposium on Computer Architecture

SN - 1063-6897

ER -