model-verification open-source-ai inference-apis ai-transparency

How an inference provider can prove they're not serving a quantized model

How Tinfoil Proves Exactly What Model Is Running

tinfoil.sh

February 21, 2026

10 min read

🔥🔥🔥🔥🔥

46/100

Summary

Tinfoil verifies the identity of models served through inference APIs, ensuring users receive the exact model weights as published. It addresses concerns about potential modifications, such as quantization or altered context windows, in open-source models.

Key Takeaways

Tinfoil developed Modelwrap, a system that cryptographically guarantees the specific model weights being served to clients during inference requests.
Modelwrap includes a public commitment to model weights, a binding mechanism to the inference server, and a client-side verification process to ensure the integrity of the model.
The system uses a combination of boot-time attestation and runtime verification to ensure that only the committed model weights are accessed during inference.
A Merkle tree is utilized in Modelwrap to authenticate large model weights with a small commitment, allowing for efficient verification of data integrity.

Read original article

View story →

Coverage & discussions

Hacker News · tinfoil.sh

How an inference provider can prove they're not serving a quantized model ↗

Community discussions

Hacker News discussion ↗

Historical count: 5 · 5 saved in sample · Historical sample

Analysis ready

Community Sentiment

Negative

Positives

Allowing users to provide the seed for generation could enhance transparency, enabling comparisons between different providers and ensuring consistency in model outputs.

Concerns

The proposed method of attestation does not guarantee that the inference provider is running the claimed model, as they could simply provide a hash of any output they choose.
Local verification does not address the need for remote validation, leaving users uncertain about the integrity of the model being used.