Skip to content

Baseten: Elephant 1 (free) vs h2o-lightning-4b

Baseten: Elephant 1 (free) and h2o-lightning-4b have no measured difference in accuracy, calibration or cost in our data yet.

SpecBaseten: Elephant 1 (free)h2o-lightning-4b
ProviderBasetenH2O.ai
Decision Index score——
Calibration error (ECE)——
Median latency (p50)——
Cost per 1,000 decisionsFree—
Parameters—5B
Open weights—Yes
Question types—Choice (one of N options), Score (ordered rubric), Yes / no
Mechanism—Decoder LM with a decision readout
License—apache-2.0

FAQ

Is Baseten: Elephant 1 (free) or h2o-lightning-4b more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, Baseten: Elephant 1 (free) or h2o-lightning-4b?

No calibration difference between Baseten: Elephant 1 (free) and h2o-lightning-4b is recorded yet.

Is Baseten: Elephant 1 (free) or h2o-lightning-4b cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.