Six inference providers, graded on what they can actually prove about the machines serving your requests. A grade measures coverage of a proof surface: a vendor-rooted quote answering a live challenge, the endpoint bound into that quote, the boot measured, the release pinned, the GPU attested. Only independently verified checks earn points. Provider claims set expectations and never score.
Evidence is checked against vendor roots of trust — TDX quotes against Intel PCS, SEV-SNP against AMD KDS, GPU evidence against NVIDIA NRAS, supply-chain bundles against Sigstore. Every response is signed, and every grade is reproducible: chopmark verify <provider> runs the same checks this page does.
Questions, corrections, or a provider you want covered: disputes@chopmark.dev
| provider | grade | coverage | level | checks | last verified | identity anchors |
|---|---|---|---|---|---|---|
| chutes | A · 87 | si✓ bd✓ lv✓ mb✓ gpu✓ sc✓ fl✓ | L5 | 73✓ 0✗ | 2026-09-22 08:12 UTC | instance_count=7 |
| nearai | B · 82 | si⚠ bd✓ lv✓ mb✓ gpu✓ sc⚠ fl✓ | L5 / clean L0 | 26✓ 0✗ | 2026-09-22 08:13 UTC | measured_os-image-hash=da9a3d5cc196a1a7… compose_hash=7e11ac339aab9d18… |
| phala | B · 80 | si✓ bd✓ lv✓ mb✓ gpu· sc⚠ fl· | L4 / clean L3 | 10✓ 0✗ | 2026-09-22 08:13 UTC | keyset_digest=ef8a03c0c5e34931… measured_os-image-hash=bd369a8c2f9edb2b… |
| redpill | A · 87 | si✓ bd✓ lv✓ mb✓ gpu✓ sc✓ fl✓ | L5 | 115✓ 0✗ | 2026-09-22 08:13 UTC | instance_count=7 |
| tinfoil | A · 85 | si✓ bd✓ lv✓ mb✓ gpu· sc✓ fl· | L4 | 6✓ 0✗ | 2026-09-22 08:13 UTC | release_tag=v0.0.152 |
| venice | F · 73 | si✓ bd✓ lv✓ mb✗ gpu✓ sc⚠ fl✓ | L2 | 14✓ 2✗ | 2026-09-22 08:13 UTC | measured_os-image-hash=a6eafc5f007f642d… compose_hash=c82b1a2eaf699615… |
coverage: si silicon_root · bd endpoint_binding · lv liveness · mb measured_boot · gpu · sc supply_chain · fl fleet — ✓ proven ⚠ warned ✗ expected but absent · not applicable. Points are earned only by independently verified checks; claims never score.
level: L1 challenge · L2 bound · L3 measured · L4 reproducible · L5 full. The first number is how far the proof reaches; a second number is how far it reaches with no warnings at all. A caveated root of trust leaves no clean rung, so "L5 / clean L0" means full scope and nothing unqualified.
| when | provider | severity | kind | detail |
|---|---|---|---|---|
| 09-22 08:13 | venice | info | fact_change | mr_aggregated changed: 8a4aafea4e6b3ffd055af09754ccbd53ff0548b1b6da89994efe8ec026dfb7d2 → 34255d6a2d970cacce85137e41cdc8435e556b7c140420c411b95f7cbb58cfc6 |
| 09-22 08:13 | venice | info | fact_change | measured_compose-hash changed: 55db164f4f8c6a837c2217c601c21bba4758f908536a6cd5b2978550205a9179 → c82b1a2eaf6996154a5f39ae621643f034b082d5e51edd3d2ba6009273881d86 |
| 09-22 08:13 | venice | info | fact_change | instance_id changed: 19aea1693533dc2d529db03e3f725f20bde8d66d → 7bb9af0ac5b0e22dde3903218f58e56f743164a1 |
| 09-22 08:13 | venice | info | fact_change | compose_hash changed: 55db164f4f8c6a837c2217c601c21bba4758f908536a6cd5b2978550205a9179 → c82b1a2eaf6996154a5f39ae621643f034b082d5e51edd3d2ba6009273881d86 |
| 09-22 08:13 | nearai | info | fact_change | instance_id changed: 5fcc082c-926a-4021-92fc-1aa061570d22 → a857031d-bd04-411c-93fc-439c254c9dc4 |
| 09-22 07:13 | venice | info | fact_change | mr_aggregated changed: 2afe299caa25e667948f92fc2d440cd2fcba1fcf0ab7a6f56643972687ced4aa → 8a4aafea4e6b3ffd055af09754ccbd53ff0548b1b6da89994efe8ec026dfb7d2 |
| 09-22 07:13 | venice | info | fact_change | measured_compose-hash changed: 945bcfade2aec53a19da7638774a99caea11395ec03e572a13357a0c63b152b4 → 55db164f4f8c6a837c2217c601c21bba4758f908536a6cd5b2978550205a9179 |
| 09-22 07:13 | venice | info | fact_change | instance_id changed: cc796618bcd5a6b22907d8de7ac414a968d6a1aa → 19aea1693533dc2d529db03e3f725f20bde8d66d |
| 09-22 07:13 | venice | info | fact_change | compose_hash changed: 945bcfade2aec53a19da7638774a99caea11395ec03e572a13357a0c63b152b4 → 55db164f4f8c6a837c2217c601c21bba4758f908536a6cd5b2978550205a9179 |
| 09-22 07:13 | redpill | info | fact_change | e2e_pubkey changed: jwan29uaWYiw5QJ2MbQqy6VCqYBfVVa7ntTD/skqlzO6NWzO2aEQLKN07juhIVlH22E8nHigvGByHfJlDFdSy8A2xWR+YDmHcsqmz3UvH9xEmXmQPedP2izGQSGoHPoaf/kwQ7d865zLLVoZujerBkIqh1RnwxS4mDm09dUwHGlPrTaV38JEIpi3ElUqwKloNiWlrbcifJNPN2hPjRPB0fwR5cvEE4RiktUcIpGADzSQI8mfZIEHS1GZRuo8oKV40dg8Jyke7hJSxGxYOAZiV9yq3jetwKTFfWslTjnKupd0GUrMGDWdpTSn1RWqAZsKIVDCymhKWtZqQuupxAJLlXqhhkVf10u8AZqYi7VyEmqIeXZtQeOGr0YZghZs5WeiTPmsJfq8SJhgDmm8Q6la/zJhmINGVsZwD/ObzWuekYdiEoRUAiUFozOw9SXEMMZ+e1HBeASOjOGtFkNUstmNjSKzZOQyIaIGuOwaoZS4QyFl4WGLlZyANhCFw0grlVWiFFIDYfc6dTHATxulDMZSh+UFZ4bMT4fG9rLBsRNLy3Q1bVp514gSKKFA2vZK7fIGQcpMMbECzYRH9sGkaWSdPYJM8alNI3cQCsRyhYGoSVa1/3nL8tlgXJga5yC/+1WmKOCJ2XuzbsYXL3o7yOqc87vH09swe2tABDoO5Pm02gAX4zdvfmENeLp2UgtlQRV7UVYy2LkYoNVxHZqk4DBdNaTNlbRnyBBBVlUFcryIdKpQoymRuoeeDjCrzNqmDRF5mdZDuKasQ9tX8IezHcqFDYeMSgvGssRUOtNQ1BJLJTyte9iN1WpBEcueCLF3sJe1YBQysYVAitcR18hnN8Nv4kZfbYwv9nk2JTA0x7FFU2R/D9Bofbd/bwe+dUxMoVsdI+HMq+MSyrCnmFaTe7Mh9oeKtgLPPTOBpax/WiKqiAC+UJzJhtPKMPFnJwOVc+y7jsVoAqptKFiz7ous76ZxSvA1qvtaLcpV8eg2Yth6dTWsgmqBG/TDm6EItXStzPKk9dsrMgan61Mq7+ImvjQlYuiR6AAyfCe+tdG8aONCPiSlCCwk7BNGqekY83g25CeLfVeJzcKWTmu5Z0O20iIr/Qdj53SxVYG76Tozesp5sKptvmd80akjDsJOgHHGMVWX9VV6cZciR+w96pmgcpuGLqJscMc+T0AYK2qloRGS9PSY7aqnX6MPrqie5AiU7Zpr+UN8TJDF8gAo3MiqjmQhDXGxEsYRKsdqqRsjS2SHVER5IsRutGsCGblRrvqVAjFkOfqhdeR3Q8sCPNBVzwmxX/QakHiEZCexvSWS/Ll852ckpOtg1DSFogHLFMkva/KG02FiiBoxGuqkajggjIcriKcVTKRmeycIVLiPCNdCmgIqfiWwXwlEqRXN4jMjcCO3AteloWGA4vhpCedRk3g3gGUd1InLGxUPDfohXGs26OOK8almwUqrm9NLJlRwUnHBrPN0eksgwikBAlQSIhyWu3FMrWmu4DvFunMBwNgUEkd6uZmz5mB1rZFgafI/z6e+kef0KY7QzuZltwR6vFUja6iViRn5Gj+qDGh9rqN2Sy4= → fFUeiOYPRzvBQsyUEWpaqmybXLQsoikzyKMGwKGBppMRKDq/9IKZ2Pytk0Vt60M18wsWWKcQShJQ+VsVWyI1AhgY4jilkTDDTgyhDzApvfVhWoVNYjwblWB2WKsKZpcBandGsQwa4Gx0pxFUCcRk+cgxt5yX4sN/o9OU8nlaLgN+YAEbrSchxkuTsYdWKdRzPbUhj9OCixRsN1Cw+gkQnbY8rUxbhrIZj2OGf3U3bBig7dc5KoccY+Gtn+nOtUhI56mNseMcZRYRg0gGandAmPaVhptZAFdZ3UZj70gZr+Yr0lOf5AhKSJuRhqwbewfLr9EgJJIlGuZMueh4+xvMH/CnezxqQboU2OJ9gOUIW2J0RHkEgKlZZQevHHdzdKCJzxQW5laSsfXG7EGLcpahVqWaguAc1bKyUuixi2KecngzmExFNZyOYfYRMFB+OxwfhUjJ7vt8mETEcaKZY3kdw1LD/0rLVSuQ1Ww0/vnN1sq+pbCvP9Z5UPZq6TCmXeq4vqIDQjaRL5MF+LiHv/QCECVEk8iqbyxJMrgsEmQm1Ds2Y9cDIPE61vUZPQuWBHAlC6K3iUAlSDWomZoxcKizhNxVaHWKcvOGawchDDAYLoZ2B6yJflnIKei8MOZFxhoBvKCp0lw0YwimPDGBnca1ZXugzTWjOwXNYnXI/fGVxSG6pgLITpBBgUgYF1IK5pQZLzRdtYxwjedUiCQD1gY/6ZKoIlTP3sE8z+qv/nB/zidaQ0RTYZKN4dMVidJ245etLcVwj9PMuFcNyiQ0MJyPdIy7FsrAMRVpout2i+I37Nu3Bjs9y1mTIwKTyqa8Z7cLV/nF7exLGWdnxrNmpDyg8IRjcHPFHtSh0HtyOfpC83Z/a/pBwgJKnWdwrCSACRl5kzB3JcbECslncms/oTMVKAG8HFsl0ndkz8kWXtBZEwuW4NJckpugw6lL1CE3UcXOWroQdPSh5xs1gtNlVfhe+IVldlmN+XM9BLJTd2qnnfnPGLQvWuEZbPuz5/xizzDL+HOthss6kopDw7RUy1o1c1yPRioag/lbjTrPQlku2XeWjwk0NfFnL5gYGClorwGFsOhbOnMkV4GqleRftXksWBWXKqyXT8izEQY4mLBCp2h5DsyQMtyGCVh3nxtcKEeflqdbBxi5TwJggmxee/jH85o0MZi7WjRJSOCouaI3NhmGhYAPy7KTHvcMeSQFdrBjlZxN+KB2eNIOZSOjShs+aGnHOPYQ4xCeP/HFzLYMFgUgr7gJlQqOyEmJ+WUUaNJtYKp2fumW/waKNYkr3BwKmBwv7XvEnOwfQnDDAhUJDPHMYbKbbbWtUGjLIVpVytrMN5iSf8IPTOlS5+PMZfmiKuZWsXpWVyPFONkyEvkofCdpJER7LHcDKmNENkgal/EzqkSQKizPq3Gaz7FzBExkpkvKzRoAaZmFD0dGXiscnHiAZzeItcG25YqhDxoJF5O9tHS9oaeVDbckzRqqHzQpBpUVIEg4z9gK1QEaghOWwTouNcYVNTQbcziUnHGZrWGO4aB8OogY6XL9K2l/kMRkOlSxogxApFPfSgL9TJCGZos= |
| 09-22 07:13 | nearai | info | fact_change | measurement_config changed: 8xh200 [10.2.1, NVSW0] v1.3.1 → 8xh200 [10.2.1] v1.3.1 |
| 09-22 07:13 | nearai | info | fact_change | instance_id changed: 47cc097b-4a8e-4a5e-a377-cb5a1e987301 → 5fcc082c-926a-4021-92fc-1aa061570d22 |
| 09-22 06:13 | venice | info | fact_change | mr_aggregated changed: 34255d6a2d970cacce85137e41cdc8435e556b7c140420c411b95f7cbb58cfc6 → 2afe299caa25e667948f92fc2d440cd2fcba1fcf0ab7a6f56643972687ced4aa |
| 09-22 06:13 | venice | info | fact_change | measured_compose-hash changed: c82b1a2eaf6996154a5f39ae621643f034b082d5e51edd3d2ba6009273881d86 → 945bcfade2aec53a19da7638774a99caea11395ec03e572a13357a0c63b152b4 |
| 09-22 06:13 | venice | info | fact_change | instance_id changed: 7bb9af0ac5b0e22dde3903218f58e56f743164a1 → cc796618bcd5a6b22907d8de7ac414a968d6a1aa |
| 09-22 06:13 | venice | info | fact_change | compose_hash changed: c82b1a2eaf6996154a5f39ae621643f034b082d5e51edd3d2ba6009273881d86 → 945bcfade2aec53a19da7638774a99caea11395ec03e572a13357a0c63b152b4 |
| 09-22 06:13 | redpill | info | grade_transition | grade ERR → A () |
| 09-22 06:13 | nearai | info | grade_transition | grade ERR → B (warn:chutes_verification: integrity token b3fd2845… present on the served response — cllmv HMAC keyed by a validator-held session key; not third-party verifiable, so no serving proof is claimed; warn:manifest_audit: warning: audit findings: service "datadog-agent" mounts docker.sock — container control surface; service "otelcol-contrib" mounts docker.sock — container control surface; service "otelcol-contrib" mounts host /; service "dstack-vpc-client" uses host network; service "dstack-service-mesh" runs privileged; service "dstack-service-mesh" mounts docker.sock — container control surface; warn:release_pinned: warning: measured image da9a3d5cc196 is not a vendor-published release; warn:tdx_quote: verified with warning: TDX TCB info reported by Intel PCS failed TCB status check: TCB Status is not "UpToDate", found "OutOfDate") |
| 09-22 06:12 | chutes | info | grade_transition | grade ERR → A () |
| 09-22 05:13 | redpill | info | grade_transition | grade A → ERR (fetch failed: fetch: Get "https://api.redpill.ai/v1/attestation/report?model=deepseek%2Fdeepseek-v3.2&nonce=dfee095a0e3513f2289fc1129be083534236bf8a7f52a2f7fb8ac6bc609d71f3": context deadline exceeded) |
| provider | grade | worst | downgrades | incidents | unresolved | reported loss |
|---|---|---|---|---|---|---|
| chutes | A | F | 1 | 84 | 84 | — |
| nearai | B | F | 2 | 454 | 454 | — |
| phala | B | B | 0 | 16 | 16 | — |
| redpill | A | C | 3 | 212 | 212 | — |
| tinfoil | A | B | 1 | 11 | 11 | — |
| venice | F | F | 3 | 202 | 202 | — |
A rating is only as good as its record of failures. An unreachable sweep never counts as a downgrade or a worst grade. GET /defaults serves this signed.
| task set | model | result | judge | endpoint integrity |
|---|---|---|---|---|
| judged@1.0.0 | e2ee-deepseek-v4-flash | 6 pass · 0 fail | model:deepseek-ai/DeepSeek-V3.2-TEE@1 (A 87 L5/clean L5) | B 73 L5/clean L0 |
| instruction@1.0.0 | e2ee-deepseek-v4-flash | 7 pass · 0 fail | exact-match@1 | B 73 L5/clean L0 |
| formatting@1.0.0 | e2ee-deepseek-v4-flash | 6 pass · 0 fail | json-has@1 | B 73 L5/clean L0 |
| classification@1.0.0 | e2ee-deepseek-v4-flash | 6 pass · 1 fail | one-of@1 | B 73 L5/clean L0 |
| extraction@1.0.0 | e2ee-deepseek-v4-flash | 7 pass · 0 fail | exact-match@1 | B 73 L5/clean L0 |
| reasoning@1.0.0 | e2ee-deepseek-v4-flash | 9 pass · 0 fail | exact-match@1 | B 73 L5/clean L0 |
Each set is signed and carries a verifiable reference to the scorecard's verdict on the endpoint that produced the outputs, so one artifact answers what was served, whether it was any good, and what machine served it. A judge id beginning model: is a model verdict carrying the judge's own attested standing. GET /labels streams the archive.
GET /scores · GET /score?provider=X · GET /provider?provider=X · GET /grade?provider=X&at=T · GET /allow?provider=X&min_grade=B · GET /allows?providers=X,Y · GET /spec · GET /defaults · GET /incidents · GET /evidence · GET /labels · GET /pubkey — all responses signed ed25519/JCS.
signer pubkey: d0488b99f10d265b78ad40cc22fed544dce45c4668a4468b947692dee0f31314
generated 2026-09-22T08:22:56Z