PREVIEW — for founder review, not announced. Sample scoreboard numbers and provider names are illustrative; no probes have been run.
Join the waitlist
Independent inference verification

Is your provider really serving the model you're paying for?

Same model name, different behaviour. Quantization, silent config changes and provider swaps can break tool calls and shift refusals without any notice. We test every major open-model provider daily, from the outside, and alert you when yours drifts.

Get early access
open-model-70b · tool-call accuracysample
ProviderPrecisionScoreStatus
Provider Abf1699.8%stable
Provider Bfp898.9%stable
Provider Cfp895.4%watch
Provider Dint4?84.1%drift
ALERT · Provider D · tool-call accuracy fell 14.7 pts vs 7-day baseline. Precision change suspected. Pinned by 1 of your routes.
Illustrative layout only. Provider names and figures are not real measurements.

The gap is already documented

Model makers and evaluators keep finding the same thing: one model, many providers, measurably different results.

100% → 83%

Tool-call schema accuracy for the same Kimi K2 model across API vendors, in the model maker's own verifier.

Moonshot AI, K2 Vendor Verifier (test 2025-11-15)
11% → 83%

Refusal rates for Llama 3.3 70B across four providers serving the same model.

Surelio.ai (2026)
0

Independent, continuous checks you can subscribe to today. Routers grade their own providers; labs build one-off verifiers for their own models.

How it works

We never sit in your request path and never need your API keys.

Probe

Every day we send a fixed battery of tests to each provider: tool-call schemas, refusals, long-context recall, encoding and output fingerprints against a reference.

Score

Each provider and model gets a public daily score and a history, so you can see who is stable and who changed.

Alert

Tell us which providers your product depends on. When one drifts from its baseline, you hear about it in Slack or email before your users do.

Join the waitlist

We're choosing the first models and providers to cover based on who signs up.

Preview only: this form is not connected yet.

No spam. We'll email when the public scoreboard is live.