SRP: Symbiotic resource partitioning of the memory hierarchy in CMPs

Shekhar Srikantaiah, Mahmut Kandemir

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

There have been many recent works in the context of Chip Multiprocessors (CMPs) investigating the need of intelligent shared cache partitioning which is believed to reduce the pressure on the off-chip bandwidth. Management of the off-chip memory bandwidth to improve system performance and/or mitigate performance volatility of applications has itself received considerable attention. Coordinated resource management schemes treat the interactions between cache allocation and bandwidth management as a black-box. This hinders the ability of these schemes from exploiting the intricate inter-relationships between the resource management strategies. In a multiprogrammed scenario, given the limited availability of the on-chip cache, it is not feasible to entirely eliminate off-chip accesses. However, it is possible to mitigate the impact of additional queueing delays associated with the memory controller by avoiding multiple applications from exercising the off-chip bandwidth simultaneously. Therefore, from the point of view of improving system performance, it is more important to have a symbiotic resource partitioning scheme that performs partitioning of each resource based on feedback it receives from the partitioning of the other. Symbiotic resource partitioning (SRP) proposed in this paper avoids the scenarios of multiple applications exercising the off-chip memory bandwidth simultaneously by appropriately controlling the cache partitioning. In order to control the cache partitioning, SRP employs an empirical model that relies on a metric (last level cache misses per cycle) that represents the off-chip memory bandwidth demand of the applications and models the impact of cache partitioning on bandwidth demand by representing the last level cache misses per cycle metric as a function of the cache allocation per application. This model is dynamically updated to account for the phase behavior of the applications. Moreover, SRP is an iterative approach wherein each iteration of the approach consists of an update to the model, cache partitioning and bandwidth partitioning with a feedback from bandwidth partitioning that updates the model. Extensive simulations with a full system simulator and applications from the MiBench benchmark suite shows that SRP leads to a significant overall improvement in system performance as compared to a state-of the-art cache and bandwidth management schemes.

Original languageEnglish (US)
Title of host publicationHigh Performance Embedded Architectures and Compilers - 5th International Conference, HiPEAC 2010, Proceedings
Pages277-291
Number of pages15
DOIs
StatePublished - Mar 25 2010
Event5th International Conference on High Performance Embedded Architectures and Compilers, HiPEAC 2010 - Pisa, Italy
Duration: Jan 25 2010Jan 27 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5952 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other5th International Conference on High Performance Embedded Architectures and Compilers, HiPEAC 2010
CountryItaly
CityPisa
Period1/25/101/27/10

Fingerprint

Memory Hierarchy
Chip multiprocessors
Partitioning
Cache
Bandwidth
Data storage equipment
Resources
Chip
System Performance
Resource Management
Feedback
Update
Phase behavior
Cycle
Metric
Scenarios
Empirical Model
Queueing
Simulators
Availability

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Srikantaiah, S., & Kandemir, M. (2010). SRP: Symbiotic resource partitioning of the memory hierarchy in CMPs. In High Performance Embedded Architectures and Compilers - 5th International Conference, HiPEAC 2010, Proceedings (pp. 277-291). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5952 LNCS). https://doi.org/10.1007/978-3-642-11515-8_21
Srikantaiah, Shekhar ; Kandemir, Mahmut. / SRP : Symbiotic resource partitioning of the memory hierarchy in CMPs. High Performance Embedded Architectures and Compilers - 5th International Conference, HiPEAC 2010, Proceedings. 2010. pp. 277-291 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{e535439879744022994dc7c27436c56e,
title = "SRP: Symbiotic resource partitioning of the memory hierarchy in CMPs",
abstract = "There have been many recent works in the context of Chip Multiprocessors (CMPs) investigating the need of intelligent shared cache partitioning which is believed to reduce the pressure on the off-chip bandwidth. Management of the off-chip memory bandwidth to improve system performance and/or mitigate performance volatility of applications has itself received considerable attention. Coordinated resource management schemes treat the interactions between cache allocation and bandwidth management as a black-box. This hinders the ability of these schemes from exploiting the intricate inter-relationships between the resource management strategies. In a multiprogrammed scenario, given the limited availability of the on-chip cache, it is not feasible to entirely eliminate off-chip accesses. However, it is possible to mitigate the impact of additional queueing delays associated with the memory controller by avoiding multiple applications from exercising the off-chip bandwidth simultaneously. Therefore, from the point of view of improving system performance, it is more important to have a symbiotic resource partitioning scheme that performs partitioning of each resource based on feedback it receives from the partitioning of the other. Symbiotic resource partitioning (SRP) proposed in this paper avoids the scenarios of multiple applications exercising the off-chip memory bandwidth simultaneously by appropriately controlling the cache partitioning. In order to control the cache partitioning, SRP employs an empirical model that relies on a metric (last level cache misses per cycle) that represents the off-chip memory bandwidth demand of the applications and models the impact of cache partitioning on bandwidth demand by representing the last level cache misses per cycle metric as a function of the cache allocation per application. This model is dynamically updated to account for the phase behavior of the applications. Moreover, SRP is an iterative approach wherein each iteration of the approach consists of an update to the model, cache partitioning and bandwidth partitioning with a feedback from bandwidth partitioning that updates the model. Extensive simulations with a full system simulator and applications from the MiBench benchmark suite shows that SRP leads to a significant overall improvement in system performance as compared to a state-of the-art cache and bandwidth management schemes.",
author = "Shekhar Srikantaiah and Mahmut Kandemir",
year = "2010",
month = "3",
day = "25",
doi = "10.1007/978-3-642-11515-8_21",
language = "English (US)",
isbn = "3642115144",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "277--291",
booktitle = "High Performance Embedded Architectures and Compilers - 5th International Conference, HiPEAC 2010, Proceedings",

}

Srikantaiah, S & Kandemir, M 2010, SRP: Symbiotic resource partitioning of the memory hierarchy in CMPs. in High Performance Embedded Architectures and Compilers - 5th International Conference, HiPEAC 2010, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5952 LNCS, pp. 277-291, 5th International Conference on High Performance Embedded Architectures and Compilers, HiPEAC 2010, Pisa, Italy, 1/25/10. https://doi.org/10.1007/978-3-642-11515-8_21

SRP : Symbiotic resource partitioning of the memory hierarchy in CMPs. / Srikantaiah, Shekhar; Kandemir, Mahmut.

High Performance Embedded Architectures and Compilers - 5th International Conference, HiPEAC 2010, Proceedings. 2010. p. 277-291 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5952 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - SRP

T2 - Symbiotic resource partitioning of the memory hierarchy in CMPs

AU - Srikantaiah, Shekhar

AU - Kandemir, Mahmut

PY - 2010/3/25

Y1 - 2010/3/25

N2 - There have been many recent works in the context of Chip Multiprocessors (CMPs) investigating the need of intelligent shared cache partitioning which is believed to reduce the pressure on the off-chip bandwidth. Management of the off-chip memory bandwidth to improve system performance and/or mitigate performance volatility of applications has itself received considerable attention. Coordinated resource management schemes treat the interactions between cache allocation and bandwidth management as a black-box. This hinders the ability of these schemes from exploiting the intricate inter-relationships between the resource management strategies. In a multiprogrammed scenario, given the limited availability of the on-chip cache, it is not feasible to entirely eliminate off-chip accesses. However, it is possible to mitigate the impact of additional queueing delays associated with the memory controller by avoiding multiple applications from exercising the off-chip bandwidth simultaneously. Therefore, from the point of view of improving system performance, it is more important to have a symbiotic resource partitioning scheme that performs partitioning of each resource based on feedback it receives from the partitioning of the other. Symbiotic resource partitioning (SRP) proposed in this paper avoids the scenarios of multiple applications exercising the off-chip memory bandwidth simultaneously by appropriately controlling the cache partitioning. In order to control the cache partitioning, SRP employs an empirical model that relies on a metric (last level cache misses per cycle) that represents the off-chip memory bandwidth demand of the applications and models the impact of cache partitioning on bandwidth demand by representing the last level cache misses per cycle metric as a function of the cache allocation per application. This model is dynamically updated to account for the phase behavior of the applications. Moreover, SRP is an iterative approach wherein each iteration of the approach consists of an update to the model, cache partitioning and bandwidth partitioning with a feedback from bandwidth partitioning that updates the model. Extensive simulations with a full system simulator and applications from the MiBench benchmark suite shows that SRP leads to a significant overall improvement in system performance as compared to a state-of the-art cache and bandwidth management schemes.

AB - There have been many recent works in the context of Chip Multiprocessors (CMPs) investigating the need of intelligent shared cache partitioning which is believed to reduce the pressure on the off-chip bandwidth. Management of the off-chip memory bandwidth to improve system performance and/or mitigate performance volatility of applications has itself received considerable attention. Coordinated resource management schemes treat the interactions between cache allocation and bandwidth management as a black-box. This hinders the ability of these schemes from exploiting the intricate inter-relationships between the resource management strategies. In a multiprogrammed scenario, given the limited availability of the on-chip cache, it is not feasible to entirely eliminate off-chip accesses. However, it is possible to mitigate the impact of additional queueing delays associated with the memory controller by avoiding multiple applications from exercising the off-chip bandwidth simultaneously. Therefore, from the point of view of improving system performance, it is more important to have a symbiotic resource partitioning scheme that performs partitioning of each resource based on feedback it receives from the partitioning of the other. Symbiotic resource partitioning (SRP) proposed in this paper avoids the scenarios of multiple applications exercising the off-chip memory bandwidth simultaneously by appropriately controlling the cache partitioning. In order to control the cache partitioning, SRP employs an empirical model that relies on a metric (last level cache misses per cycle) that represents the off-chip memory bandwidth demand of the applications and models the impact of cache partitioning on bandwidth demand by representing the last level cache misses per cycle metric as a function of the cache allocation per application. This model is dynamically updated to account for the phase behavior of the applications. Moreover, SRP is an iterative approach wherein each iteration of the approach consists of an update to the model, cache partitioning and bandwidth partitioning with a feedback from bandwidth partitioning that updates the model. Extensive simulations with a full system simulator and applications from the MiBench benchmark suite shows that SRP leads to a significant overall improvement in system performance as compared to a state-of the-art cache and bandwidth management schemes.

UR - http://www.scopus.com/inward/record.url?scp=77949639020&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77949639020&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-11515-8_21

DO - 10.1007/978-3-642-11515-8_21

M3 - Conference contribution

AN - SCOPUS:77949639020

SN - 3642115144

SN - 9783642115141

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 277

EP - 291

BT - High Performance Embedded Architectures and Compilers - 5th International Conference, HiPEAC 2010, Proceedings

ER -

Srikantaiah S, Kandemir M. SRP: Symbiotic resource partitioning of the memory hierarchy in CMPs. In High Performance Embedded Architectures and Compilers - 5th International Conference, HiPEAC 2010, Proceedings. 2010. p. 277-291. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-11515-8_21