Six inference providers, graded on what they can actually prove about the machines serving your requests. A grade measures coverage of a proof surface: a vendor-rooted quote answering a live challenge, the endpoint bound into that quote, the boot measured, the release pinned, the GPU attested. Only independently verified checks earn points. Provider claims set expectations and never score.
Evidence is checked against vendor roots of trust — TDX quotes against Intel PCS, SEV-SNP against AMD KDS, GPU evidence against NVIDIA NRAS, supply-chain bundles against Sigstore. Every response is signed, and every grade is reproducible: chopmark verify <provider> runs the same checks this page does.
Questions, corrections, or a provider you want covered: disputes@chopmark.dev
| provider | grade | coverage | level | checks | last verified | identity anchors |
|---|---|---|---|---|---|---|
| chutes | A · 87 | si✓ bd✓ lv✓ mb✓ gpu✓ sc✓ fl✓ | L5 | 64✓ 0✗ | 2026-09-20 01:12 UTC | instance_count=6 |
| nearai | B · 82 | si⚠ bd✓ lv✓ mb✓ gpu✓ sc⚠ fl✓ | L5 / clean L0 | 26✓ 0✗ | 2026-09-20 01:13 UTC | measured_os-image-hash=da9a3d5cc196a1a7… compose_hash=7e11ac339aab9d18… |
| phala | B · 80 | si✓ bd✓ lv✓ mb✓ gpu· sc⚠ fl· | L4 / clean L3 | 10✓ 0✗ | 2026-09-20 01:13 UTC | keyset_digest=ef8a03c0c5e34931… measured_os-image-hash=bd369a8c2f9edb2b… |
| redpill | A · 87 | si✓ bd✓ lv✓ mb✓ gpu✓ sc✓ fl✓ | L5 | 100✓ 0✗ | 2026-09-20 01:13 UTC | instance_count=6 |
| tinfoil | A · 85 | si✓ bd✓ lv✓ mb✓ gpu· sc✓ fl· | L4 | 6✓ 0✗ | 2026-09-20 01:13 UTC | release_tag=v0.0.150 |
| venice | B · 73 | si⚠ bd✓ lv✓ mb✓ gpu✓ sc⚠ fl✓ | L5 / clean L0 | 16✓ 0✗ | 2026-09-20 01:13 UTC | measured_os-image-hash=9b69bb1698bacbb6… compose_hash=d4c89033fb55cdac… |
coverage: si silicon_root · bd endpoint_binding · lv liveness · mb measured_boot · gpu · sc supply_chain · fl fleet — ✓ proven ⚠ warned ✗ expected but absent · not applicable. Points are earned only by independently verified checks; claims never score.
level: L1 challenge · L2 bound · L3 measured · L4 reproducible · L5 full. The first number is how far the proof reaches; a second number is how far it reaches with no warnings at all. A caveated root of trust leaves no clean rung, so "L5 / clean L0" means full scope and nothing unqualified.
| when | provider | severity | kind | detail |
|---|---|---|---|---|
| 09-20 01:13 | redpill | info | fact_change | e2e_pubkey changed: 7UC1qdsisUsePjWfHsiGGIE0/QxUm5gFdVob/3pB/8BlFLTGHZM7jAu8cwGV6pBY5ZSStQaZvwhC/SdEVjBAkXByCzyncjRTTFkHbKSHoGOD72xNc8ts4Jd4+zYDNzm6F6EEFRqCq4G18dN3EuWF7WcJh0hCiDNV//QC8sGd77GZxbRrkGU/EUUD1Hdj/PIOkRBkxpIHbecmxcCvPpAPVqEJZzogjHxnHZSU3McwBjyKwTxKOxIadLG1ReM5cbEiRCyo2zG6EMyW2vIFBUEnZ6nJlPwOChrFNXILItwlyUAbjOGmmlWBWRZiyHo6nlRaIAZe92qzbOSSfFCdKxV6N1ZnitGvpVlNARPC7VulRrh1e+JkCDeAmWezU0wF1YFT3QJ+IgghKnJY4guWa4tJZ0QX5uYMujE1h2G9WBATvNIPkmQtU5shGqHJBroQhwFlOmmOAppujWE2qEHIsxYbtMSKImiA5Ps9A4Jl+ePOMyqSQZbGZxgUgeco0ah3U7hERGsMfMUBubajBYFBoIBjX3SBI2mhv5akGDpYCTmn6TRUMaKcnBCavbgYcZm58ljFASZjgYkmxwNOlPez5ruc25a1Soxco8w9cVBnAZFSOKGgj6wSk0NXzOk5QQZlZshKIvmbcmG95cNLOIS8bIUaYllblmZSrdGDHCwRxMp3TjS12aeZOTGmd3RDmWhFOFwgNeYpL6RfDaEwisETOTOhKPqY7LE4BSWlrCwdB+xsa+SLhoVg6tdyVFOn6zBbn/VLdrWvwPskSEiiVrfHXchPUbJBfYF1hFF8FbjBkwde9+afyKyUrjAZmkpEyFui9HF3phjCqLarULoM2RWGS5AQG5IXAVmZXTa92hO0qvLL4UGuHTiWZmuhLTZ/RVWmy2AEgkqcygPHXiBje5mffuQycXF8oCQ+IzZUjdY5XyBhunao+Po7RZx4O4h7lXwdDEoOp3givejHOPu8OYJhx5x3LlQAz8rFUlGB80fFJOWs1KWdaeAAFRorcmZb7Sh93gglRNQWfAwwwZAht5OqUqwBtcy46zIgUKV+YBLJKZE9jpo1pNYSIvwviBnO17cmDFEhJEg/JPSkhsJUdFukF2e89yVPLHcNFcokE4o4OTVphXKZpbZsRWk/JfBu9CTGmiLNx9TAJnY3B1I7hJeT2SEv2/qTWuRUpBRKdMU8Muy6+JmXNuW5jHG4JHSGNZhcRVNxl2J2t8rDnSrMm1PFhmNl5TwqVPiJ67RhmnILqsi1VPchFRhr8dHKrHlZFBkgpUMLX/py4JSWAaYW/3JSOnGiLbQ2GBkU06WYt1B2PHs/jAmr1IhhoVxT+6jDz1F7z+taZppPz2WmnlWFOyyft3EDQsq6s1Kg15xGtecwn/aKqiO+n4AyyCGe90h0xjgBpKeMugBd+8GOFEsSYhSj7cyMrRtyN8li4xsvhbONmbKaGneA/mBcxqMMDeUWTwqEGSo7OsHLq4K/1cufx7ye4IZAzGnGsIy/g8kQN/yABLa+mCNkk/cqG9F6O9YRwvAcL9CbYma17je5lHBEp9FOgfsiIqglxXNZcZP4KC6GT0GGurc= → 2HEqxPtLYCFRRte8Y5yly1lSnyVSrGmuo/AaKyYnQJJbV0oCKofCr6qgQiGOH0WAYVFHVMyf4JC6g0aQr1IpfmB8aGjNI8abkXy8p9Wqu7sCUZCeOXRDyjdJEiCAIkpFzTAjGaaAflCTXXGI8ACLkiaCqrBfOZLJnvIR3VE/ollNBTKYGLh/vuEjnRdfxCulRLWDXXQCFUHFO3QZMdjBywObZ4DHxMcf7xZ7peerFqmgoEBevjWwVzS2n6C83qR9pKx6PjeD2ukkLizHxaq3Tgl4Z5uelTvD8zp7WDZ+0emh0opAHxkk6tiQyaedBTUzvGWGxUKTsRc77iEbVVoDuFNhNmOek6rIq7VwKMVULrM3+0O2a+AoZyCvDvwt9hmB0yFkU3YOG0gQmXs8Acq+ZcpiSZAIAFmbXrIxTeSRdih7MqoWQYx+TNAM5IuwSEYj2vOd8airHyMWc1eBR6BHagNg/goeVRqXjTe9y5iLKtcmHCGuT9RB5LG8wTlaQAAx/oJw9bqt4zRPE+g6SoHEHCpim/e59Uc1jBaQLYszF9cmj+Kr8wgsZuSlJAqRW6loqomzN9M9y2UsfBUXLzWezIRHXrpW2gximPEuvFFweAciMcq6L1Z1RDWEoNEfg3xCsNe3d1jDahMmgBHKMLtaV6M/bSSf4CDFxwZMG+BJbgyERrvOjRVPG4hqDlF7W2Gm6id6vBlzxzZRfoxqnxx88pWMHVoZrnioxaqVE6WFgwi1bMtmvudlUDqj+iCL3ykU25bG/YuUXLo1RsQ0W4umWBZfSsZG+Iyqdhp6ZfY+yLXLwHVO9FQNdCkw5KWacJRvG0t/p8ROcdkfKTcwUQsfN7SD4HrA/rwBaVSSd3CHxSKsteYVYFNT/rlGX1Y2gpRheVa02qcOnbQ0jfdl+QZInUYJouWVtuhx4WAh1LFU2FWoHikXQpKVCUpMAXYTZiSxPvQlcMyTSKyeVUWV6LFx8eVV4EC7+4yTkLgD+yM9gicNylED5QhFpbCBcuV5g8IWGSOzRGB3PnQV9bxZGryE8slioDWESXlvd7uEAGkWMaVJkHVNR0HHOTc/XaY5rZUkooKLMheijkqCzaREqcmpVCrKFDW5VLk0o4FmU8ZJLGQtXoCcdOCT/JB9DktT+CaZhHnMmxZxlLMrR2t2JzbMTtgBTBeXxuDE9msbSrqDUyp4Cidmx/ehF7YtTwQ9lfJuXdWgerBksMeUG1lMHhYGEUKJ/XZMXZZCDEqjTJZsKTmXzbN2mTJ2y5BH2Nm+TwucnHXPZkN3tiyrtDmQgZtXsrCUmORjEtJ9bOSZkwPAoYYgsBwz4bcoEESRZZNrlMGZUeghtvrOKok4NTm6x/duvrN/D8y/zbgUiuNWjfl3KKG2y2pdGgQUZ1a8glY340MxhNOt44g6l4dGR7Z7L1wnjUGO/aJUECWWdAaJHYWLKiFbJOOJobqGlUEAodBwcOuvO2FM5CZ6YUHKmbYJqQtVnzejnxyHiqTOHmmaz9dJPpWyjbtAlSTDDTu/NHKiixKJCXXp37F12RmUHj5pYEddaVArXM2RsBLXmfBVTnp1wuk= |
| 09-20 01:13 | redpill | info | fact_change | instance_id changed: ddace810-48c8-4a55-86b2-41a867ccfd97 → 71a86431-9e1f-4e9e-9819-d39e6f931cc4 |
| 09-20 01:13 | phala | info | fact_change | keyset_digest changed: sha256:a36d6a240e7b45c41a46181285cdc10c803afc9e874197c774096811b4dad014 → sha256:ef8a03c0c5e349310394c0d5865f766f8a1258f1acdb5fcb6ed2ebcd757e5f5a |
| 09-20 01:13 | nearai | info | fact_change | instance_id changed: 2cfe6427-2347-4095-ac44-585c16117344 → 30d6029a-0646-4eab-994b-15dbebfcee99 |
| 09-20 01:13 | nearai | info | fact_change | measurement_config changed: 8xh200 [10.1.0] v1.3.1 → 8xh200 [10.2.1] v1.3.1 |
| 09-20 00:13 | venice | info | fact_change | mr_aggregated changed: 2afe299caa25e667948f92fc2d440cd2fcba1fcf0ab7a6f56643972687ced4aa → 5cbf8ac60acba249cf8f28015e7a6e0884ed0c15686f398c07d68800157ac2fb |
| 09-20 00:13 | venice | major | fact_change | measured_os-image-hash changed: a6eafc5f007f642d8ea90c7fa8881f1e6715720ccb531941a28218f4f26d7b02 → 9b69bb1698bacbb6985409a2c272bcb892e09cdcea63d5399c6768b67d3ff677 |
| 09-20 00:13 | venice | info | fact_change | ohttp_signing_key changed: 5a0210f2442c79355784f9de021985429561da5bacc3a4424b01ac52b7e0caff → 15a56bb079a0cae6594e649512789ba120bc098aafebb2a8cf6309d6ed24115f |
| 09-20 00:13 | venice | info | fact_change | instance_id changed: cc796618bcd5a6b22907d8de7ac414a968d6a1aa → 112c1f2d03be6911d527afc116671cfff006dd65 |
| 09-20 00:13 | venice | minor | fact_change | device_id changed: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 → 3dc12fcbd396722090ddbc9406879d1febd577e7868dc89a5ef1f5dbc353a539 |
| 09-20 00:13 | venice | major | fact_change | os_image_hash changed: a6eafc5f007f642d8ea90c7fa8881f1e6715720ccb531941a28218f4f26d7b02 → 9b69bb1698bacbb6985409a2c272bcb892e09cdcea63d5399c6768b67d3ff677 |
| 09-20 00:13 | venice | minor | fact_change | app_name changed: dstack-nvidia-0.5.11 → dstack-nvidia-0.5.5 |
| 09-20 00:13 | venice | info | grade_transition | grade F → B (warn:manifest_audit: warning: audit findings: service "compose-manager" shares host PID namespace; service "compose-manager" mounts docker.sock — container control surface; service "compose-manager" adds capability SYS_ADMIN; service "compose-manager-launcher" uses host network; service "compose-manager-launcher" mounts docker.sock — container control surface; service "otelcol-management" mounts docker.sock — container control surface; service "otelcol-management" mounts host /; pre_launch_script runs unmeasured code at boot; warn:release_pinned: warning: measured image 9b69bb1698ba is not a vendor-published release; warn:tdx_quote: verified with warning: TDX TCB info reported by Intel PCS failed TCB status check: TDX Module TCB Status is not "UpToDate", found "OutOfDate") |
| 09-20 00:13 | venice | info | fact_change | signing_address changed: 0x3b753b4406613c5e70ae640508632b600424fa0c → 0xd70fa57802b741fcbf4c6569bd6f82b723a2e11f |
| 09-20 00:13 | venice | major | fact_change | vm_image changed: dstack-nvidia-0.5.11 → dstack-nvidia-0.5.5 |
| 09-20 00:13 | venice | info | fact_change | measured_compose-hash changed: 945bcfade2aec53a19da7638774a99caea11395ec03e572a13357a0c63b152b4 → d4c89033fb55cdac9db00c775fbbbeff6319fba7249344b2dca99b23ff048479 |
| 09-20 00:13 | venice | info | fact_change | compose_hash changed: 945bcfade2aec53a19da7638774a99caea11395ec03e572a13357a0c63b152b4 → d4c89033fb55cdac9db00c775fbbbeff6319fba7249344b2dca99b23ff048479 |
| 09-20 00:13 | redpill | info | fact_change | e2e_pubkey changed: 2HEqxPtLYCFRRte8Y5yly1lSnyVSrGmuo/AaKyYnQJJbV0oCKofCr6qgQiGOH0WAYVFHVMyf4JC6g0aQr1IpfmB8aGjNI8abkXy8p9Wqu7sCUZCeOXRDyjdJEiCAIkpFzTAjGaaAflCTXXGI8ACLkiaCqrBfOZLJnvIR3VE/ollNBTKYGLh/vuEjnRdfxCulRLWDXXQCFUHFO3QZMdjBywObZ4DHxMcf7xZ7peerFqmgoEBevjWwVzS2n6C83qR9pKx6PjeD2ukkLizHxaq3Tgl4Z5uelTvD8zp7WDZ+0emh0opAHxkk6tiQyaedBTUzvGWGxUKTsRc77iEbVVoDuFNhNmOek6rIq7VwKMVULrM3+0O2a+AoZyCvDvwt9hmB0yFkU3YOG0gQmXs8Acq+ZcpiSZAIAFmbXrIxTeSRdih7MqoWQYx+TNAM5IuwSEYj2vOd8airHyMWc1eBR6BHagNg/goeVRqXjTe9y5iLKtcmHCGuT9RB5LG8wTlaQAAx/oJw9bqt4zRPE+g6SoHEHCpim/e59Uc1jBaQLYszF9cmj+Kr8wgsZuSlJAqRW6loqomzN9M9y2UsfBUXLzWezIRHXrpW2gximPEuvFFweAciMcq6L1Z1RDWEoNEfg3xCsNe3d1jDahMmgBHKMLtaV6M/bSSf4CDFxwZMG+BJbgyERrvOjRVPG4hqDlF7W2Gm6id6vBlzxzZRfoxqnxx88pWMHVoZrnioxaqVE6WFgwi1bMtmvudlUDqj+iCL3ykU25bG/YuUXLo1RsQ0W4umWBZfSsZG+Iyqdhp6ZfY+yLXLwHVO9FQNdCkw5KWacJRvG0t/p8ROcdkfKTcwUQsfN7SD4HrA/rwBaVSSd3CHxSKsteYVYFNT/rlGX1Y2gpRheVa02qcOnbQ0jfdl+QZInUYJouWVtuhx4WAh1LFU2FWoHikXQpKVCUpMAXYTZiSxPvQlcMyTSKyeVUWV6LFx8eVV4EC7+4yTkLgD+yM9gicNylED5QhFpbCBcuV5g8IWGSOzRGB3PnQV9bxZGryE8slioDWESXlvd7uEAGkWMaVJkHVNR0HHOTc/XaY5rZUkooKLMheijkqCzaREqcmpVCrKFDW5VLk0o4FmU8ZJLGQtXoCcdOCT/JB9DktT+CaZhHnMmxZxlLMrR2t2JzbMTtgBTBeXxuDE9msbSrqDUyp4Cidmx/ehF7YtTwQ9lfJuXdWgerBksMeUG1lMHhYGEUKJ/XZMXZZCDEqjTJZsKTmXzbN2mTJ2y5BH2Nm+TwucnHXPZkN3tiyrtDmQgZtXsrCUmORjEtJ9bOSZkwPAoYYgsBwz4bcoEESRZZNrlMGZUeghtvrOKok4NTm6x/duvrN/D8y/zbgUiuNWjfl3KKG2y2pdGgQUZ1a8glY340MxhNOt44g6l4dGR7Z7L1wnjUGO/aJUECWWdAaJHYWLKiFbJOOJobqGlUEAodBwcOuvO2FM5CZ6YUHKmbYJqQtVnzejnxyHiqTOHmmaz9dJPpWyjbtAlSTDDTu/NHKiixKJCXXp37F12RmUHj5pYEddaVArXM2RsBLXmfBVTnp1wuk= → 7UC1qdsisUsePjWfHsiGGIE0/QxUm5gFdVob/3pB/8BlFLTGHZM7jAu8cwGV6pBY5ZSStQaZvwhC/SdEVjBAkXByCzyncjRTTFkHbKSHoGOD72xNc8ts4Jd4+zYDNzm6F6EEFRqCq4G18dN3EuWF7WcJh0hCiDNV//QC8sGd77GZxbRrkGU/EUUD1Hdj/PIOkRBkxpIHbecmxcCvPpAPVqEJZzogjHxnHZSU3McwBjyKwTxKOxIadLG1ReM5cbEiRCyo2zG6EMyW2vIFBUEnZ6nJlPwOChrFNXILItwlyUAbjOGmmlWBWRZiyHo6nlRaIAZe92qzbOSSfFCdKxV6N1ZnitGvpVlNARPC7VulRrh1e+JkCDeAmWezU0wF1YFT3QJ+IgghKnJY4guWa4tJZ0QX5uYMujE1h2G9WBATvNIPkmQtU5shGqHJBroQhwFlOmmOAppujWE2qEHIsxYbtMSKImiA5Ps9A4Jl+ePOMyqSQZbGZxgUgeco0ah3U7hERGsMfMUBubajBYFBoIBjX3SBI2mhv5akGDpYCTmn6TRUMaKcnBCavbgYcZm58ljFASZjgYkmxwNOlPez5ruc25a1Soxco8w9cVBnAZFSOKGgj6wSk0NXzOk5QQZlZshKIvmbcmG95cNLOIS8bIUaYllblmZSrdGDHCwRxMp3TjS12aeZOTGmd3RDmWhFOFwgNeYpL6RfDaEwisETOTOhKPqY7LE4BSWlrCwdB+xsa+SLhoVg6tdyVFOn6zBbn/VLdrWvwPskSEiiVrfHXchPUbJBfYF1hFF8FbjBkwde9+afyKyUrjAZmkpEyFui9HF3phjCqLarULoM2RWGS5AQG5IXAVmZXTa92hO0qvLL4UGuHTiWZmuhLTZ/RVWmy2AEgkqcygPHXiBje5mffuQycXF8oCQ+IzZUjdY5XyBhunao+Po7RZx4O4h7lXwdDEoOp3givejHOPu8OYJhx5x3LlQAz8rFUlGB80fFJOWs1KWdaeAAFRorcmZb7Sh93gglRNQWfAwwwZAht5OqUqwBtcy46zIgUKV+YBLJKZE9jpo1pNYSIvwviBnO17cmDFEhJEg/JPSkhsJUdFukF2e89yVPLHcNFcokE4o4OTVphXKZpbZsRWk/JfBu9CTGmiLNx9TAJnY3B1I7hJeT2SEv2/qTWuRUpBRKdMU8Muy6+JmXNuW5jHG4JHSGNZhcRVNxl2J2t8rDnSrMm1PFhmNl5TwqVPiJ67RhmnILqsi1VPchFRhr8dHKrHlZFBkgpUMLX/py4JSWAaYW/3JSOnGiLbQ2GBkU06WYt1B2PHs/jAmr1IhhoVxT+6jDz1F7z+taZppPz2WmnlWFOyyft3EDQsq6s1Kg15xGtecwn/aKqiO+n4AyyCGe90h0xjgBpKeMugBd+8GOFEsSYhSj7cyMrRtyN8li4xsvhbONmbKaGneA/mBcxqMMDeUWTwqEGSo7OsHLq4K/1cufx7ye4IZAzGnGsIy/g8kQN/yABLa+mCNkk/cqG9F6O9YRwvAcL9CbYma17je5lHBEp9FOgfsiIqglxXNZcZP4KC6GT0GGurc= |
| 09-20 00:13 | redpill | info | fact_change | instance_id changed: 71a86431-9e1f-4e9e-9819-d39e6f931cc4 → ddace810-48c8-4a55-86b2-41a867ccfd97 |
| 09-20 00:13 | nearai | info | fact_change | measurement_config changed: 8xh200 [10.2.1] v1.3.1 → 8xh200 [10.1.0] v1.3.1 |
| provider | grade | worst | downgrades | incidents | unresolved | reported loss |
|---|---|---|---|---|---|---|
| chutes | A | F | 1 | 46 | 46 | — |
| nearai | B | C | 1 | 348 | 348 | — |
| phala | B | B | 0 | 16 | 16 | — |
| redpill | A | C | 3 | 149 | 149 | — |
| tinfoil | A | B | 1 | 7 | 7 | — |
| venice | B | F | 0 | 26 | 26 | — |
A rating is only as good as its record of failures. An unreachable sweep never counts as a downgrade or a worst grade. GET /defaults serves this signed.
| task set | model | result | judge | endpoint integrity |
|---|---|---|---|---|
| judged@1.0.0 | e2ee-deepseek-v4-flash | 6 pass · 0 fail | model:deepseek-ai/DeepSeek-V3.2-TEE@1 (A 87 L5/clean L5) | B 73 L5/clean L0 |
| instruction@1.0.0 | e2ee-deepseek-v4-flash | 7 pass · 0 fail | exact-match@1 | B 73 L5/clean L0 |
| formatting@1.0.0 | e2ee-deepseek-v4-flash | 6 pass · 0 fail | json-has@1 | B 73 L5/clean L0 |
| classification@1.0.0 | e2ee-deepseek-v4-flash | 6 pass · 1 fail | one-of@1 | B 73 L5/clean L0 |
| extraction@1.0.0 | e2ee-deepseek-v4-flash | 7 pass · 0 fail | exact-match@1 | B 73 L5/clean L0 |
| reasoning@1.0.0 | e2ee-deepseek-v4-flash | 9 pass · 0 fail | exact-match@1 | B 73 L5/clean L0 |
Each set is signed and carries a verifiable reference to the scorecard's verdict on the endpoint that produced the outputs, so one artifact answers what was served, whether it was any good, and what machine served it. A judge id beginning model: is a model verdict carrying the judge's own attested standing. GET /labels streams the archive.
GET /scores · GET /score?provider=X · GET /provider?provider=X · GET /grade?provider=X&at=T · GET /allow?provider=X&min_grade=B · GET /allows?providers=X,Y · GET /spec · GET /defaults · GET /incidents · GET /evidence · GET /labels · GET /pubkey — all responses signed ed25519/JCS.
signer pubkey: d0488b99f10d265b78ad40cc22fed544dce45c4668a4468b947692dee0f31314
generated 2026-09-20T01:35:11Z