Modern web services must meet critical non-functional requirements such as availability, responsiveness, scalability, and reliability, which are formalized through Service Level Agreements (SLAs). These agreements specify Service Level Objectives (SLOs), which define performance targets like uptime, latency, and throughput, essential for ensuring consistent service quality. Failure to meet SLOs can result in penalties and reputational damage. Service providers also face the challenge of avoiding over-provisioning resources, as this leads to unnecessary costs and inefficient resource use. To address this, autoscaling mechanisms dynamically adjust the number of service replicas to match user demand. However, traditional autoscaling solutions typically rely on low-level metrics (e.g., CPU or memory usage), making it difficult for providers to optimize both SLOs and infrastructure costs. This paper proposes an enhanced autoscaling methodology for containerized workloads in Kubernetes clusters, integrating SLOs with a cost-driven autoscaling policy. This approach overcomes the limitations of conventional autoscaling by making more efficient decisions that balance service-level requirements with operational costs, offering a comprehensive solution for managing containerized applications and their infrastructure in Kubernetes environments. The results, obtained by evaluating a prototype of our system in a testbed environment, show significant advantages over the vanilla Kubernetes Horizontal Pod Autoscaler.
SLO and Cost-Driven Container Autoscaling on Kubernetes Clusters
Marchese A.;Tomarchio O.
2025-01-01
Abstract
Modern web services must meet critical non-functional requirements such as availability, responsiveness, scalability, and reliability, which are formalized through Service Level Agreements (SLAs). These agreements specify Service Level Objectives (SLOs), which define performance targets like uptime, latency, and throughput, essential for ensuring consistent service quality. Failure to meet SLOs can result in penalties and reputational damage. Service providers also face the challenge of avoiding over-provisioning resources, as this leads to unnecessary costs and inefficient resource use. To address this, autoscaling mechanisms dynamically adjust the number of service replicas to match user demand. However, traditional autoscaling solutions typically rely on low-level metrics (e.g., CPU or memory usage), making it difficult for providers to optimize both SLOs and infrastructure costs. This paper proposes an enhanced autoscaling methodology for containerized workloads in Kubernetes clusters, integrating SLOs with a cost-driven autoscaling policy. This approach overcomes the limitations of conventional autoscaling by making more efficient decisions that balance service-level requirements with operational costs, offering a comprehensive solution for managing containerized applications and their infrastructure in Kubernetes environments. The results, obtained by evaluating a prototype of our system in a testbed environment, show significant advantages over the vanilla Kubernetes Horizontal Pod Autoscaler.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


