Test Result Staging
Currently, we don’t have performance metrics, so I’m using AOA performance metrics as a reference. Link: https://docs.google.com/document/d/176BIL9CrDz3C32MRsIpNGY6hKGt-IIInzGscHk-RTkQ/edit
Performance Metrics:
| Metric | Target Value | Description |
|---|---|---|
| Http req duration avg | < 3000 ms | Average response time should be below 3000 milliseconds (3 seconds) |
| Http req duration 95% | < 3000 ms | 95th percentile response time should be faster than 3000 milliseconds (3 seconds) |
| Http req duration 90% | < 3000 ms | 90th percentile response time should be faster than 3000 milliseconds (3 seconds) |
| Http Req failed rate | < 0.05 (5%) | The rate of failed requests should be less than 5% |
Failures indicate capacity/performance limits under load; see the metric table for violations.
Test with 100 Virtual Users
| Parameter | Value | Description |
|---|---|---|
| Virtual Users | 100 | Number of concurrent virtual users |
| Duration | 10m | Duration of the test |
| Parallelism | 3 | How many k6 test runner jobs the operator should spawn |
| Status | PASS | The test passed the performance metrics |
Result Job 1
Result Job 2
Result Job 3
Result All Jobs
Aiven Load
Test with 200 Virtual Users
| Parameter | Value | Description |
|---|---|---|
| Virtual Users | 200 | Number of concurrent virtual users |
| Duration | 10m | Duration of the test |
| Parallelism | 3 | How many k6 test runner jobs the operator should spawn |
| Status | PASS | The test passed the performance metrics |
Result Job 1
Result Job 2
Result Job 3
Result All Jobs
Aiven Load
Test with 300 Virtual Users
| Parameter | Value | Description |
|---|---|---|
| Virtual Users | 300 | Number of concurrent virtual users |
| Duration | 10m | Duration of the test |
| Parallelism | 3 | How many k6 test runner jobs the operator should spawn |
| Status | PASS | The test passed the performance metrics |
Result Job 1
Result Job 2
Result Job 3
Result All Jobs
Aiven Load
Test with 400 Virtual Users
| Parameter | Value | Description |
|---|---|---|
| Virtual Users | 400 | Number of concurrent virtual users |
| Duration | 10m | Duration of the test |
| Parallelism | 3 | How many k6 test runner jobs the operator should spawn |
| Status | FAILED | The test did not pass the performance metrics (see metric table for violations) |
Result Job 1
Result Job 2
Result Job 3
Result All Jobs
Test with 500 Virtual Users
| Parameter | Value | Description |
|---|---|---|
| Virtual Users | 500 | Number of concurrent virtual users |
| Duration | 10m | Duration of the test |
| Parallelism | 3 | How many k6 test runner jobs the operator should spawn |
| Status | FAILED | The test did not pass the performance metrics (see metric table for violations) |
Result Job 1
Result Job 2
Result Job 3
Result All Jobs
Aiven Load