Vertical Scaling for Redis Replication Clusters with KubeBlocks

This guide demonstrates how to vertically scale a Redis Replication Cluster managed by KubeBlocks by adjusting compute resources (CPU and memory) while maintaining the same number of replicas.

Vertical scaling modifies compute resources (CPU and memory) for Redis instances while maintaining replica count. Key characteristics:

• Non-disruptive: When properly configured, maintains availability during scaling
• Granular: Adjust CPU, memory, or both independently
• Reversible: Scale up or down as needed

KubeBlocks orchestrates scaling with minimal impact:

1. Secondary replicas update first
2. Primary updates last after secondaries are healthy
3. Cluster status transitions from Updating to Running

Prerequisites

Before proceeding, ensure the following:

• Environment Setup:
  • A Kubernetes cluster is up and running.
  • The kubectl CLI tool is configured to communicate with your cluster.
  • KubeBlocks CLI and KubeBlocks Operator are installed. Follow the installation instructions here.
• Namespace Preparation: To keep resources isolated, create a dedicated namespace for this tutorial:

kubectl create ns demo
namespace/demo created

Deploy a Redis Replication Cluster

KubeBlocks uses a declarative approach for managing Redis Replication Clusters. Below is an example configuration for deploying a Redis Replication Cluster with two components, redis and redis sentinel.

Apply the following YAML configuration to deploy the cluster:

apiVersion: apps.kubeblocks.io/v1
kind: Cluster
metadata:
  name: redis-replication
  namespace: demo
spec:
  terminationPolicy: Delete
  clusterDef: redis
  topology: replication
  componentSpecs:
    - name: redis
      serviceVersion: "7.2.4"
      disableExporter: false
      replicas: 2
      resources:
        limits:
          cpu: '0.5'
          memory: 0.5Gi
        requests:
          cpu: '0.5'
          memory: 0.5Gi
      volumeClaimTemplates:
        - name: data
          spec:
            storageClassName: ""
            accessModes:
              - ReadWriteOnce
            resources:
              requests:
                storage: 20Gi
    - name: redis-sentinel
      replicas: 3
      resources:
        limits:
          cpu: '0.5'
          memory: 0.5Gi
        requests:
          cpu: '0.5'
          memory: 0.5Gi
      volumeClaimTemplates:
        - name: data
          spec:
            storageClassName: ""
            accessModes:
              - ReadWriteOnce
            resources:
              requests:
                storage: 20Gi

Verifying the Deployment

Monitor the cluster status until it transitions to the Running state:

kubectl get cluster redis-replication -n demo -w

Expected Output:

NAME                CLUSTER-DEFINITION   TERMINATION-POLICY   STATUS    AGE
redis-replication   redis                Delete               Running   3m49s

Check the pod status and roles:

kubectl get pods -l app.kubernetes.io/instance=redis-replication -L  kubeblocks.io/role -n demo

Expected Output:

NAME                                 READY   STATUS    RESTARTS   AGE     ROLE
redis-replication-redis-0            3/3     Running   0          3m38s   primary
redis-replication-redis-1            3/3     Running   0          3m16s   secondary
redis-replication-redis-sentinel-0   2/2     Running   0          4m35s
redis-replication-redis-sentinel-1   2/2     Running   0          4m17s
redis-replication-redis-sentinel-2   2/2     Running   0          3m59s

Once the cluster status becomes Running, your Redis cluster is ready for use.

Vertical Scale

Expected Workflow:

1. Secondary replicas are updated first (one at a time)
2. Primary is updated last after secondary replicas are healthy
3. Cluster status transitions from Updating to Running

apiVersion: operations.kubeblocks.io/v1alpha1
kind: OpsRequest
metadata:
  name: redis-replication-vscale-ops
  namespace: demo
spec:
  clusterName: redis-replication
  type: VerticalScaling
  verticalScaling:
  - componentName: redis
    requests:
      cpu: '1'
      memory: 1Gi
    limits:
      cpu: '1'
      memory: 1Gi

kubectl -n demo get ops redis-replication-vscale-ops -w

NAME                           TYPE              CLUSTER             STATUS    PROGRESS   AGE
redis-replication-vscale-ops   VerticalScaling   redis-replication   Running   0/2        11s
redis-replication-vscale-ops   VerticalScaling   redis-replication   Running   1/2        36s
redis-replication-vscale-ops   VerticalScaling   redis-replication   Running   2/2        52s
redis-replication-vscale-ops   VerticalScaling   redis-replication   Running   2/2        52s
redis-replication-vscale-ops   VerticalScaling   redis-replication   Succeed   2/2        52s

apiVersion: apps.kubeblocks.io/v1
kind: Cluster
spec:
  componentSpecs:
    - name: redis
      serviceVersion: "7.2.4"
      disableExporter: false
      replicas: 2
      resources:
        requests:
          cpu: "1"       # Update the resources to your need.
          memory: "1Gi"  # Update the resources to your need.
        limits:
          cpu: "1"       # Update the resources to your need.
          memory: "1Gi"  # Update the resources to your need.
  ...

Best Practices & Considerations

Planning:

• Scale during maintenance windows or low-traffic periods
• Verify Kubernetes cluster has sufficient resources
• Check for any ongoing operations before starting

Execution:

• Maintain balanced CPU-to-Memory ratios
• Set identical requests/limits for guaranteed QoS

Post-Scaling:

• Monitor resource utilization and application performance
• Consider adjusting Redis parameters if needed

Verification

Verify the updated resources by inspecting the cluster configuration or Pod details:

kbcli cluster describe redis-replication -n demo

Expected Output:

Resources Allocation:
COMPONENT        INSTANCE-TEMPLATE   CPU(REQUEST/LIMIT)   MEMORY(REQUEST/LIMIT)   STORAGE-SIZE   STORAGE-CLASS
redis                                1 / 1                1Gi / 1Gi               data:20Gi      <none>
redis-sentinel                       500m / 500m          512Mi / 512Mi           data:20Gi      <none>

Only resources for Redis component have been updated, but those for redis-sentinel remain the same.

Key Benefits of Vertical Scaling with KubeBlocks

• Seamless Scaling: Pods are recreated in a specific order to ensure minimal disruption.
• Dynamic Resource Adjustments: Easily scale CPU and memory based on workload requirements.
• Flexibility: Choose between OpsRequest for dynamic scaling or direct API updates for precise control.
• Improved Availability: The cluster remains operational during the scaling process, maintaining high availability.

Cleanup

To remove all created resources, delete the Redis Replication Cluster along with its namespace:

kubectl delete cluster redis-replication -n demo
kubectl delete ns demo

Summary

In this guide, you learned how to:

1. Deploy a Redis Replication Cluster managed by KubeBlocks.
2. Perform vertical scaling by increasing or decreasing resources for the redis component.
3. Use both OpsRequest and direct Cluster API updates to adjust resource allocations.

Vertical scaling is a powerful tool for optimizing resource utilization and adapting to changing workload demands, ensuring your Redis Replication Cluster remains performant and resilient.