Skip to content

Autoloops – Gemma 4 31B IT vs Baseten: Mammoth 1 (free)

Autoloops – Gemma 4 31B IT and Baseten: Mammoth 1 (free) have no measured difference in accuracy, calibration or cost in our data yet.

SpecAutoloops – Gemma 4 31B ITBaseten: Mammoth 1 (free)
ProviderAutoloopsBaseten
Decision Index score——
Calibration error (ECE)——
Median latency (p50)——
Cost per 1,000 decisions—Free
Parameters31B—
Open weightsNo—
Question typesChoice (one of N options), Score (ordered rubric), Yes / no—
MechanismHosted API—
Licenseproprietary—

FAQ

Is Autoloops – Gemma 4 31B IT or Baseten: Mammoth 1 (free) more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, Autoloops – Gemma 4 31B IT or Baseten: Mammoth 1 (free)?

No calibration difference between Autoloops – Gemma 4 31B IT and Baseten: Mammoth 1 (free) is recorded yet.

Is Autoloops – Gemma 4 31B IT or Baseten: Mammoth 1 (free) cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.