SHOWAR: Right-sizing and efficient scheduling of microservices

Ataollah Fatahi Baarzi, George Kesidis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Microservices architecture have been widely adopted in designing distributed cloud applications where the application is decoupled into multiple small components (i.e. "microservices"). One of the challenges in deploying microservices is finding the optimal amount of resources (i.e. size) and the number of instances (i.e. replicas) for each microservice in order to maintain a good performance as well as prevent resource wastage and under-utilization which is not cost-effective. This paper presents SHOWAR, a framework that configures the resources by determining the number of replicas (horizontal scaling) and the amount of CPU and Memory for each microservice (vertical scaling). For vertical scaling, SHOWAR uses empirical variance in the historical resource usage to find the optimal size and mitigate resource wastage. For horizontal scaling, SHOWAR uses basic ideas from control theory along with kernel level performance metrics. Additionally, once the size for each microservice is found, SHOWAR bridges the gap between optimal resource allocation and scheduling by generating affinity rules (i.e. hints) for the scheduler to further improve the performance. Our experiments, using a variety of microservice applications and real-world workloads, show that, compared to the state-of-the-art autoscaling and scheduling systems, SHOWAR on average improves the resource allocation by up to 22% while improving the 99th percentile end-to-end user request latency by 20%.

Original languageEnglish (US)
Title of host publicationSoCC 2021 - Proceedings of the 2021 ACM Symposium on Cloud Computing
PublisherAssociation for Computing Machinery, Inc
Pages427-441
Number of pages15
ISBN (Electronic)9781450386388
DOIs
StatePublished - Nov 1 2021
Event12th Annual ACM Symposium on Cloud Computing, SoCC 2021 - Virtual, Online, United States
Duration: Nov 1 2021Nov 4 2021

Publication series

NameSoCC 2021 - Proceedings of the 2021 ACM Symposium on Cloud Computing

Conference

Conference12th Annual ACM Symposium on Cloud Computing, SoCC 2021
Country/TerritoryUnited States
CityVirtual, Online
Period11/1/2111/4/21

All Science Journal Classification (ASJC) codes

  • Computational Theory and Mathematics
  • Computer Science Applications

Cite this