Modern web services are expected to meet key non-functional requirements - such as availability, responsiveness, scalability, and reliability - typically formalized through Service Level Agreements (SLAs). These agreements specify Service Level Objectives (SLOs), including metrics such as latency, throughput, and uptime, to guarantee consistent service quality. Failure to meet these targets can result in financial penalties and reputational damage, while excessive resource provisioning leads to wasted costs and inefficiencies.Autoscaling techniques help address this challenge by dynamically adjusting the number of service replicas based on demand. However, traditional autoscaling methods mainly depend on low-level indicators such as CPU and memory usage, limiting their effectiveness in balancing SLO compliance with cost efficiency. This paper introduces an enhanced feedback-control-based autoscaling approach for containerized applications, specifically tailored for Kubernetes environments, which directly incorporates response time SLOs into scaling decisions. By doing so, the proposed method enhances scaling accuracy and achieves a better trade-off between performance and resource utilization. Experimental results from a prototype implementation show significant improvements over the standard Kubernetes Horizontal Pod Autoscaler and another autoscaling methodology proposed in literature.

An SLO-Driven Feedback Controller for Kubernetes Horizontal Pod Autoscaling

Marchese A.;Tomarchio O.
2026-01-01

Abstract

Modern web services are expected to meet key non-functional requirements - such as availability, responsiveness, scalability, and reliability - typically formalized through Service Level Agreements (SLAs). These agreements specify Service Level Objectives (SLOs), including metrics such as latency, throughput, and uptime, to guarantee consistent service quality. Failure to meet these targets can result in financial penalties and reputational damage, while excessive resource provisioning leads to wasted costs and inefficiencies.Autoscaling techniques help address this challenge by dynamically adjusting the number of service replicas based on demand. However, traditional autoscaling methods mainly depend on low-level indicators such as CPU and memory usage, limiting their effectiveness in balancing SLO compliance with cost efficiency. This paper introduces an enhanced feedback-control-based autoscaling approach for containerized applications, specifically tailored for Kubernetes environments, which directly incorporates response time SLOs into scaling decisions. By doing so, the proposed method enhances scaling accuracy and achieves a better trade-off between performance and resource utilization. Experimental results from a prototype implementation show significant improvements over the standard Kubernetes Horizontal Pod Autoscaler and another autoscaling methodology proposed in literature.
2026
Cloud computing
Container technology
Feedback control
Kubernetes autoscaler
Service level objectives
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11769/738714
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact