Workers AI runs inference for Moonshot's Kimi K-series and Z.ai's GLM models on GPUs in Cloudflare data centers. These models are large, long-context, and mixture-of-experts types, presenting challenges in efficient serving due to memory constraints.

Big news: Kimi-K3 by @Kimi_Moonshot is now #1 in the Frontend Code Arena with 1679 pts, surpassing Claude Fable 5. This is a 17-place jump from Kimi-k2.6 (#18 -> #1). In Frontend, Kimi-K3 ranked #1 in 6 of 7 domains: Brand & Marketing, Reference-Based Design, Data & Analytics, Consumer Product, Simulations, and Content Creation Tools, landing #2 only in Gaming behind Fable 5. The full model weight...

The Kimi Vendor Verifier (KVV) project has been open-sourced alongside the Kimi K2.6 model to assist users in verifying the accuracy of their inference implementations. KVV aims to ensure that open-source models run correctly across different environments.