Skip to content

Baseten: Mammoth 1 (free) vs Standard One 8B SH (v3)

Baseten: Mammoth 1 (free) and Standard One 8B SH (v3) have no measured difference in accuracy, calibration or cost in our data yet.

SpecBaseten: Mammoth 1 (free)Standard One 8B SH (v3)
ProviderBasetenStandard Thinking
Decision Index score—42.9
Calibration error (ECE)—0.106
Median latency (p50)—90 ms
Cost per 1,000 decisionsFree—
Parameters—9B
Open weights—Yes
Question types—Choice (one of N options), Score (ordered rubric), Yes / no
Mechanism—Decoder LM with a decision readout
License—apache-2.0

FAQ

Is Baseten: Mammoth 1 (free) or Standard One 8B SH (v3) more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, Baseten: Mammoth 1 (free) or Standard One 8B SH (v3)?

No calibration difference between Baseten: Mammoth 1 (free) and Standard One 8B SH (v3) is recorded yet.

Is Baseten: Mammoth 1 (free) or Standard One 8B SH (v3) cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.