Workers AI runs inference for Moonshot's Kimi K-series and Z.ai's GLM models on GPUs in Cloudflare data centers. These models are large, long-context, and mixture-of-experts types, presenting challenges in efficient serving due to memory constraints.

The Kimi Vendor Verifier (KVV) project has been open-sourced alongside the Kimi K2.6 model to assist users in verifying the accuracy of their inference implementations. KVV aims to ensure that open-source models run correctly across different environments.