Skip to content

Baseten: Mammoth 1 (free) vs system-one

Baseten: Mammoth 1 (free) and system-one have no measured difference in accuracy, calibration or cost in our data yet.

SpecBaseten: Mammoth 1 (free)system-one
ProviderBasetensgoedecke
Decision Index score——
Calibration error (ECE)——
Median latency (p50)——
Cost per 1,000 decisionsFree—
Parameters——
Open weights—Yes
Question types—Choice (one of N options), Score (ordered rubric), Yes / no
Mechanism—Decoder LM with a decision readout
License——

FAQ

Is Baseten: Mammoth 1 (free) or system-one more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, Baseten: Mammoth 1 (free) or system-one?

No calibration difference between Baseten: Mammoth 1 (free) and system-one is recorded yet.

Is Baseten: Mammoth 1 (free) or system-one cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.