Kubernetes management platform: evaluation
Admission policies on manifests with known violations, and rightsizing judged on the weeks after the recommendation.
1.00policy F1 on forms written after freezing (searching the text: 0.34)
59.6%less CPU requested on held-out workloads
0 vs 92OOM-killed leaking and batch workloads (average x 1.2)
0violations introduced by automatic fixes
Admission policies (F1)
| Manifests | Policy engine | Searching the YAML text | Auto-fixed |
|---|---|---|---|
| Forms the engine was written against | 1.000 | 0.725 | 339 of 339 |
| Same forms, new manifests | 1.000 | 0.707 | 348 of 348 |
| Forms written after freezing | 1.000 | 0.335 | 142 of 142 |
Rightsizing
| Workloads | Method | CPU vs today | Memory vs today | Time above request | OOM-killed |
|---|---|---|---|---|---|
| Held-out workloads | Recommended (this platform) | 40.4% | 52.9% | 0.1% | 0 of 300 |
| Held-out workloads | Average x 1.2 | 26.9% | 49.9% | 21.1% | 0 of 300 |
| Held-out workloads | Today's requests | 100.0% | 100.0% | 0.0% | 0 of 300 |
| Leaks and batch (held back) | Recommended (this platform) | 19.3% | 54.5% | 1.3% | 0 of 200 |
| Leaks and batch (held back) | Average x 1.2 | 9.4% | 39.3% | 18.2% | 92 of 200 |
| Leaks and batch (held back) | Today's requests | 100.0% | 100.0% | 0.0% | 0 of 200 |
Gate (regression limits)
| Check | Value | Limit | Result |
|---|---|---|---|
| heldout_policy_f1_min | 1.0 | 0.99 | pass |
| fresh_policy_f1_min | 1.0 | 0.98 | pass |
| autofix_introduced_max | 0 | 0 | pass |
| heldout_rightsizing_time_above_request_max | 0.001 | 0.01 | pass |
| held_back_oom_killed_max | 0 | 0 | pass |
| heldout_cpu_vs_current_max | 0.404 | 0.6 | pass |