Field service: evaluation
Synthetic regions of 10 technicians over four weeks; settings chosen on separate tuning regions.
91.7% vs 75.7%appointments kept: optimised plans vs the dispatcher's list (held-out)
43% lessdriving per job (10.7 km vs 18.7)
99.6% vs 72.8%first-time fix: van kit planned for the day vs a standard kit
90.4%first-time fix with the planned kit in the shifted regions, where a quarter of brands were new
Held-out regions: 10 regions
| Planner | Appointments kept | km per job | Overtime h / tech-day | Avg days waited | Backlog |
|---|---|---|---|---|---|
| Dispatcher's list (nearest free technician, in booking order) | 75.7% | 18.7 | 0.09 | 0.27 | 205 |
| Optimised (tight windows first, cheapest insertion, moves between routes) | 91.7% | 10.7 | 0.09 | 0.10 | 125 |
First-time fix: standard kit 72.8%, planned kit 99.6%.
Shifted regions (held back): busier, new brands, less history: 6 regions
| Planner | Appointments kept | km per job | Overtime h / tech-day | Avg days waited | Backlog |
|---|---|---|---|---|---|
| Dispatcher's list (nearest free technician, in booking order) | 60.3% | 17.9 | 0.43 | 0.46 | 250 |
| Optimised (tight windows first, cheapest insertion, moves between routes) | 84.4% | 11.1 | 0.28 | 0.16 | 196 |
First-time fix: standard kit 71.9%, planned kit 90.4%.
Tuning regions: 4 regions
| Planner | Appointments kept | km per job | Overtime h / tech-day | Avg days waited | Backlog |
|---|---|---|---|---|---|
| Dispatcher's list (nearest free technician, in booking order) | 75.4% | 18.9 | 0.09 | 0.32 | 109 |
| Optimised (tight windows first, cheapest insertion, moves between routes) | 88.9% | 10.4 | 0.10 | 0.15 | 90 |
First-time fix: standard kit 73.8%, planned kit 99.5%.
Gate (limits written before the held-out run)
| Check | Value | Limit | Result |
|---|---|---|---|
| heldout_km_ratio_max | 0.5717 | 0.75 | pass |
| heldout_kept_gain_min | 0.1599 | 0.05 | pass |
| heldout_first_time_fix_gain_min | 0.2685 | 0.1 | pass |
| shifted_km_ratio_max | 0.6196 | 0.8 | pass |
| shifted_first_time_fix_gain_min | 0.185 | 0.05 | pass |