COMP: Compiler Optimizations for Manycore Processors

Linhai Song, Min Feng, Nishkam Ravi, Yi Yang, Srimat Chakradhar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Applications executing on multicore processors can now easily offload computations to many core processors, such as Intel Xeon Phi coprocessors. However, it requires high levels of expertise and effort to tune such offloaded applications to realize high-performance execution. Previous efforts have focused on optimizing the execution of offloaded computations on many core processors. However, we observe that the data transfer overhead between multicore and many core processors, and the limited device memories of many core processors often constrain the performance gains that are possible by offloading computations. In this paper, we present three source-to-source compiler optimizations that can significantly improve the performance of applications that offload computations to many core processors. The first optimization automatically transforms offloaded codes to enable data streaming, which overlaps data transfer between multicore and many core processors with computations on these processors to hide data transfer overhead. This optimization is also designed to minimize the memory usage on many core processors, while achieving the optimal performance. The second compiler optimization re-orders computations to regularize irregular memory accesses. It enables data streaming and factorization on many core processors, even when the memory access patterns in the original source codes are irregular. Finally, our new shared memory mechanism provides efficient support for transferring large pointer-based data structures between hosts and many core processors. Our evaluation shows that the proposed compiler optimizations benefit 9 out of 12 benchmarks. Compared with simply offloading the original parallel implementations of these benchmarks, we can achieve 1.16x-52.21x speedups.

Original languageEnglish (US)
Title of host publicationProceedings - 47th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2014
PublisherIEEE Computer Society
Pages659-671
Number of pages13
EditionJanuary
ISBN (Electronic)9781479969982
DOIs
StatePublished - Jan 15 2015
Event47th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2014 - Cambridge, United Kingdom
Duration: Dec 13 2014Dec 17 2014

Publication series

NameProceedings of the Annual International Symposium on Microarchitecture, MICRO
NumberJanuary
Volume2015-January
ISSN (Print)1072-4451

Other

Other47th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2014
CountryUnited Kingdom
CityCambridge
Period12/13/1412/17/14

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture

Cite this

Song, L., Feng, M., Ravi, N., Yang, Y., & Chakradhar, S. (2015). COMP: Compiler Optimizations for Manycore Processors. In Proceedings - 47th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2014 (January ed., pp. 659-671). [7011425] (Proceedings of the Annual International Symposium on Microarchitecture, MICRO; Vol. 2015-January, No. January). IEEE Computer Society. https://doi.org/10.1109/MICRO.2014.30