vLLM-SR d3 (27B) vs GLiNER2.5-Decide
vLLM-SR d3 (27B) is more accurate on the Jev Decision Index, vLLM-SR d3 (27B) is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.
| Spec | vLLM-SR d3 (27B) | GLiNER2.5-Decide |
|---|---|---|
| Provider | vLLM Semantic Router | Fastino |
| Decision Index score | 67.2 | 10.1 |
| Calibration error (ECE) | 0.043 | 0.088 |
| Median latency (p50) | 97 ms | 23 ms |
| Cost per 1,000 decisions | — | — |
| Parameters | 26B | 486M |
| Open weights | Yes | Yes |
| Question types | Choice (one of N options), Score (ordered rubric), Yes / no | Choice (one of N options), Score (ordered rubric), Yes / no, Extraction (typed spans) |
| Mechanism | Decoder LM with a decision readout | Span encoder (GLiNER family) |
| License | apache-2.0 | apache-2.0 |
FAQ
Is vLLM-SR d3 (27B) or GLiNER2.5-Decide more accurate?
vLLM-SR d3 (27B) scores higher on the Jev Decision Index (67.2 vs 10.1).
Which is better calibrated, vLLM-SR d3 (27B) or GLiNER2.5-Decide?
vLLM-SR d3 (27B) has the lower expected calibration error (0.043 vs 0.088), so its stated confidence is closer to how often it is right.
Is vLLM-SR d3 (27B) or GLiNER2.5-Decide cheaper per 1,000 decisions?
A hosted price is not recorded for both models; open-weight models cost the compute you run them on.
Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.