Toddler: Detecting performance problems via similar memory-access patterns

Adrian Nistor, Linhai Song, Darko Marinov, Shan Lu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

91 Scopus citations

Abstract

Performance bugs are programming errors that create significant performance degradation. While developers often use automated oracles for detecting functional bugs, detecting performance bugs usually requires time-consuming, manual analysis of execution profiles. The human effort for performance analysis limits the number of performance tests analyzed and enables performance bugs to easily escape to production. Unfortunately, while profilers can successfully localize slow executing code, profilers cannot be effectively used as automated oracles. This paper presents Toddler, a novel automated oracle for performance bugs, which enables testing for performance bugs to use the well established and automated process of testing for functional bugs. Toddler reports code loops whose computation has repetitive and partially similar memory-access patterns across loop iterations. Such repetitive work is likely unnecessary and can be done faster. We implement Toddler for Java and evaluate it on 9 popular Java codebases. Our experiments with 11 previously known, real-world performance bugs show that Toddler finds these bugs with a higher accuracy than the standard Java profiler. Using Toddler, we also found 42 new bugs in six Java projects: Ant, Google Core Libraries, JUnit, Apache Collections, JDK, and JFreeChart. Based on our bug reports, developers so far fixed 10 bugs and confirmed 6 more as real bugs.

Original languageEnglish (US)
Title of host publication2013 35th International Conference on Software Engineering, ICSE 2013 - Proceedings
Pages562-571
Number of pages10
DOIs
StatePublished - Oct 30 2013
Event2013 35th International Conference on Software Engineering, ICSE 2013 - San Francisco, CA, United States
Duration: May 18 2013May 26 2013

Publication series

NameProceedings - International Conference on Software Engineering
ISSN (Print)0270-5257

Other

Other2013 35th International Conference on Software Engineering, ICSE 2013
CountryUnited States
CitySan Francisco, CA
Period5/18/135/26/13

All Science Journal Classification (ASJC) codes

  • Software

Fingerprint Dive into the research topics of 'Toddler: Detecting performance problems via similar memory-access patterns'. Together they form a unique fingerprint.

  • Cite this

    Nistor, A., Song, L., Marinov, D., & Lu, S. (2013). Toddler: Detecting performance problems via similar memory-access patterns. In 2013 35th International Conference on Software Engineering, ICSE 2013 - Proceedings (pp. 562-571). [6606602] (Proceedings - International Conference on Software Engineering). https://doi.org/10.1109/ICSE.2013.6606602