Testing
Load testing Headlamp
Can Headlamp work well with busy clusters?
Limits we want to test for to begin with:
- 10,000 pods
- 1,000 nodes
- 10,000 events
- 15 clusters (300 clusters max)
Steps:
- Create load in a cluster
- Run Headlamp and see if it works well compared to low load
- performance profiles
- CPU/memory usage
- feel
Kwok for low resource usage load testing of Headlamp
KWOK is a toolkit that enables setting up a cluster of thousands of Nodes in seconds. Under the scene, all Nodes are simulated to behave like real ones, so the overall approach employs a pretty low resource footprint that you can easily play around on your laptop.
Creating lots of Kubernetes activity
Maybe you need to delete a cluster and create a fresh one.
kwokctl delete cluster
kwokctl create cluster
Make sure your kubectl context is set to ‘kwok-kwok’.
kubectl config get-contexts
Generating Initial Data
This will create 900 nodes, 9000 pods, and 1000 events as fast as possible. Then it will create 1 event per second up to a total of 9000 events. Also one per second: 100 new nodes, and 1000 new pods. Finally it will create 15 clusters.
cd load-tests
npm install
echo "Creating initial activity: 900 nodes, 9000 pods, and 1000 events"
node scripts/create-nodes.js 900 0
node scripts/create-pods.js 9000 0
node scripts/create-events.js 1000 0
node scripts/create-deployments.js 500 0
node scripts/create-clusters.js 15 0
Generating Activity
To make some activity after the initial data is loaded.
echo "---------------"
echo "creating 1 node, 1 pod, and 1 event per second"
node scripts/create-events.js 9000 1 & node scripts/create-nodes.js 100 1 & node scripts/create-pods.js 1000 1 &
Cleaning up clusters
Kwok clusters can take up a lot of resources even doing nothing, due to the Kubernetes API server using resources even when idle.
So when you’re done, you can delete them like this.
kwokctl delete cluster --name=kwok
node scripts/create-clusters.js 15 0 --delete