Six inference providers, graded on what they can actually prove about the machines serving your requests. A grade measures coverage of a proof surface: a vendor-rooted quote answering a live challenge, the endpoint bound into that quote, the boot measured, the release pinned, the GPU attested. Only independently verified checks earn points. Provider claims set expectations and never score.
Evidence is checked against vendor roots of trust — TDX quotes against Intel PCS, SEV-SNP against AMD KDS, GPU evidence against NVIDIA NRAS, supply-chain bundles against Sigstore. Every response is signed, and every grade is reproducible: chopmark verify <provider> runs the same checks this page does.
Questions, corrections, or a provider you want covered: disputes@chopmark.dev
| provider | grade | coverage | level | checks | last verified | identity anchors |
|---|---|---|---|---|---|---|
| chutes | A · 85 | si✓ bd✓ lv✓ mb✓ gpu✓ sc✓ fl✓ | L5 | 41✓ 0✗ | 2026-10-08 04:12 UTC | instance_count=4 |
| nearai | B · 82 | si⚠ bd✓ lv✓ mb✓ gpu✓ sc⚠ fl✓ | L5 / clean L0 | 26✓ 0✗ | 2026-10-08 04:12 UTC | measured_os-image-hash=da9a3d5cc196a1a7… compose_hash=8bc802c9c8043a9c… |
| phala | B · 80 | si✓ bd✓ lv✓ mb✓ gpu· sc⚠ fl· | L4 / clean L3 | 10✓ 0✗ | 2026-10-08 04:13 UTC | keyset_digest=ef8a03c0c5e34931… measured_os-image-hash=bd369a8c2f9edb2b… |
| redpill | A · 86 | si✓ bd✓ lv✓ mb✓ gpu✓ sc✓ fl✓ | L5 | 81✓ 0✗ | 2026-10-08 04:13 UTC | instance_count=5 |
| tinfoil | ERR · 0 | — | — | 0✓ 0✗ | 2026-10-08 04:13 UTC | |
| venice | F · 73 | si✓ bd✓ lv✓ mb✗ gpu✓ sc⚠ fl✓ | L2 | 14✓ 2✗ | 2026-10-08 04:13 UTC | measured_os-image-hash=a6eafc5f007f642d… compose_hash=c82b1a2eaf699615… |
coverage: si silicon_root · bd endpoint_binding · lv liveness · mb measured_boot · gpu · sc supply_chain · fl fleet — ✓ proven ⚠ warned ✗ expected but absent · not applicable. Points are earned only by independently verified checks; claims never score.
level: L1 challenge · L2 bound · L3 measured · L4 reproducible · L5 full. The first number is how far the proof reaches; a second number is how far it reaches with no warnings at all. A caveated root of trust leaves no clean rung, so "L5 / clean L0" means full scope and nothing unqualified.
| when | provider | severity | kind | detail |
|---|---|---|---|---|
| 10-08 04:13 | tinfoil | info | grade_transition | grade A → ERR (fetch failed: https://api.github.com/repos/tinfoilsh/confidential-model-router/attestations/sha256:ad95d02b2e27b3c1d5c327f2ee9616634f841e4b2ed5a48f404e4e9f595a4876: HTTP 503) |
| 10-08 04:13 | redpill | info | fact_change | instance_count changed: 4 → 5 |
| 10-08 04:13 | redpill | info | fact_change | instance_set changed: sha256:ca2eb8f7bb594befb28a482f7ca74e4b → sha256:dd358201706f10d12b4b8c7ad9aafe0b |
| 10-08 04:13 | redpill | minor | coverage_change | points 85 → 86 |
| 10-08 04:12 | nearai | info | fact_change | measurement_config changed: 8xh200 [10.2.1, numa-188c-1128g-nvsw-node0] v1.4.1 → 8xh200 [10.2.1] v1.3.1 |
| 10-08 04:12 | nearai | info | fact_change | instance_id changed: b57c3c3d-27cd-4260-8758-8a78cbf3d54e → a00247d3-208c-4247-ba0d-40681831acbc |
| 10-08 04:12 | nearai | info | fact_change | mr_aggregated changed: 718901135ae973797fd3f6204441a0a882ae4591f727810ba99c0408f540c29f → 5cad227cecb2edae7a8e3c94e73d0cb6a773000fe3e2c6d442ec1e5c684e95a6 |
| 10-08 03:13 | venice | info | fact_change | compose_hash changed: 55db164f4f8c6a837c2217c601c21bba4758f908536a6cd5b2978550205a9179 → c82b1a2eaf6996154a5f39ae621643f034b082d5e51edd3d2ba6009273881d86 |
| 10-08 03:13 | venice | info | fact_change | measured_compose-hash changed: 55db164f4f8c6a837c2217c601c21bba4758f908536a6cd5b2978550205a9179 → c82b1a2eaf6996154a5f39ae621643f034b082d5e51edd3d2ba6009273881d86 |
| 10-08 03:13 | venice | info | fact_change | mr_aggregated changed: 970cabe421d9add109199a2f94c8707b5eda56976cd80442b668e536819413bb → 5edf871f8641baf755562204c746846fdecfa3da7dc4cedaf9ec3ffa30fcf3be |
| 10-08 03:13 | venice | info | fact_change | instance_id changed: 19aea1693533dc2d529db03e3f725f20bde8d66d → 7bb9af0ac5b0e22dde3903218f58e56f743164a1 |
| 10-08 03:13 | nearai | info | fact_change | compose_hash changed: fbc3d362670662d02c5885c03f4770452cc29de4b1bcd3180613c1ccc90979b8 → 8bc802c9c8043a9c21d1face81b9c9381ed621644478e0b7f5a7f81a7230b1fa |
| 10-08 03:13 | nearai | info | fact_change | measurement_config changed: 8xh200 [10.2.1] v1.3.1 → 8xh200 [10.2.1, numa-188c-1128g-nvsw-node0] v1.4.1 |
| 10-08 03:13 | nearai | info | fact_change | measured_compose-hash changed: fbc3d362670662d02c5885c03f4770452cc29de4b1bcd3180613c1ccc90979b8 → 8bc802c9c8043a9c21d1face81b9c9381ed621644478e0b7f5a7f81a7230b1fa |
| 10-08 03:13 | nearai | info | fact_change | instance_id changed: a00247d3-208c-4247-ba0d-40681831acbc → b57c3c3d-27cd-4260-8758-8a78cbf3d54e |
| 10-08 03:13 | nearai | info | fact_change | mr_aggregated changed: c8aa46a6e62e1af337995a2832bb12c5edda477be5a4e2edd5c0af3a2e0d6eb9 → 718901135ae973797fd3f6204441a0a882ae4591f727810ba99c0408f540c29f |
| 10-08 02:13 | venice | info | fact_change | instance_id changed: 7bb9af0ac5b0e22dde3903218f58e56f743164a1 → 19aea1693533dc2d529db03e3f725f20bde8d66d |
| 10-08 02:13 | venice | info | fact_change | mr_aggregated changed: 5edf871f8641baf755562204c746846fdecfa3da7dc4cedaf9ec3ffa30fcf3be → 970cabe421d9add109199a2f94c8707b5eda56976cd80442b668e536819413bb |
| 10-08 02:13 | venice | info | fact_change | compose_hash changed: c82b1a2eaf6996154a5f39ae621643f034b082d5e51edd3d2ba6009273881d86 → 55db164f4f8c6a837c2217c601c21bba4758f908536a6cd5b2978550205a9179 |
| 10-08 02:13 | venice | info | fact_change | measured_compose-hash changed: c82b1a2eaf6996154a5f39ae621643f034b082d5e51edd3d2ba6009273881d86 → 55db164f4f8c6a837c2217c601c21bba4758f908536a6cd5b2978550205a9179 |
| provider | grade | worst | downgrades | incidents | unresolved | reported loss |
|---|---|---|---|---|---|---|
| chutes | A | F | 2 | 217 | 217 | — |
| nearai | B | F | 3 | 1088 | 1088 | — |
| phala | B | B | 0 | 16 | 16 | — |
| redpill | A | F | 5 | 606 | 606 | — |
| tinfoil | ERR | B | 1 | 18 | 18 | — |
| venice | F | F | 3 | 1083 | 1083 | — |
A rating is only as good as its record of failures. An unreachable sweep never counts as a downgrade or a worst grade. GET /defaults serves this signed.
| task set | model | result | judge | endpoint integrity |
|---|---|---|---|---|
| judged@1.0.0 | e2ee-deepseek-v4-flash | 6 pass · 0 fail | model:deepseek-ai/DeepSeek-V3.2-TEE@1 (A 87 L5/clean L5) | B 73 L5/clean L0 |
| instruction@1.0.0 | e2ee-deepseek-v4-flash | 7 pass · 0 fail | exact-match@1 | B 73 L5/clean L0 |
| formatting@1.0.0 | e2ee-deepseek-v4-flash | 6 pass · 0 fail | json-has@1 | B 73 L5/clean L0 |
| classification@1.0.0 | e2ee-deepseek-v4-flash | 6 pass · 1 fail | one-of@1 | B 73 L5/clean L0 |
| extraction@1.0.0 | e2ee-deepseek-v4-flash | 7 pass · 0 fail | exact-match@1 | B 73 L5/clean L0 |
| reasoning@1.0.0 | e2ee-deepseek-v4-flash | 9 pass · 0 fail | exact-match@1 | B 73 L5/clean L0 |
Each set is signed and carries a verifiable reference to the scorecard's verdict on the endpoint that produced the outputs, so one artifact answers what was served, whether it was any good, and what machine served it. A judge id beginning model: is a model verdict carrying the judge's own attested standing. GET /labels streams the archive.
GET /scores · GET /score?provider=X · GET /provider?provider=X · GET /grade?provider=X&at=T · GET /allow?provider=X&min_grade=B · GET /allows?providers=X,Y · GET /spec · GET /defaults · GET /incidents · GET /evidence · GET /labels · GET /pubkey — all responses signed ed25519/JCS.
signer pubkey: d0488b99f10d265b78ad40cc22fed544dce45c4668a4468b947692dee0f31314
generated 2026-10-08T04:39:51Z