system-one-gemma vs Baseten: Elephant 1 (free)
system-one-gemma and Baseten: Elephant 1 (free) have no measured difference in accuracy, calibration or cost in our data yet.
| Spec | system-one-gemma | Baseten: Elephant 1 (free) |
|---|---|---|
| Provider | akash-kamat | Baseten |
| Decision Index score | 5.2 | — |
| Calibration error (ECE) | 0.239 | — |
| Median latency (p50) | 32 ms | — |
| Cost per 1,000 decisions | — | Free |
| Parameters | 268M | — |
| Open weights | Yes | — |
| Question types | Choice (one of N options), Score (ordered rubric), Yes / no | — |
| Mechanism | Decoder LM with a decision readout | — |
| License | — | — |
FAQ
Is system-one-gemma or Baseten: Elephant 1 (free) more accurate?
At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.
Which is better calibrated, system-one-gemma or Baseten: Elephant 1 (free)?
No calibration difference between system-one-gemma and Baseten: Elephant 1 (free) is recorded yet.
Is system-one-gemma or Baseten: Elephant 1 (free) cheaper per 1,000 decisions?
A hosted price is not recorded for both models; open-weight models cost the compute you run them on.
Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.