Themata.AI
Themata.AI

Popular tags:

#developer-tools#ai-agents#llms#claude#ai-ethics#code-generation#ai-safety#openai#anthropic#discussion

AI is changing the world. Don't stay behind. Clear summaries, community insight, delivered without the noise. Subscribe to never miss a beat.

© 2026 Themata.AI • All Rights Reserved

Privacy

|

Cookies

|

Contact
kimi-k3llmsmoonshot-aiai-benchmarks

Kimi K3, and what we can still learn from the pelican benchmark

Kimi K3, and what we can still learn from the pelican benchmark

simonwillison.net

July 17, 2026

6 min read

🔥🔥🔥🔥🔥

50/100

Summary

Moonshot AI has launched Kimi K3, their most capable model to date with 2.8 trillion parameters. It is currently accessible via their website and API, with an open weight release scheduled for July 27, 2026.

Key Takeaways

  • Moonshot AI announced the release of Kimi K3, their most capable model to date, featuring 2.8 trillion parameters.
  • Kimi K3 is the first "open 3T-class model" and is currently available via their website and API, with an open weight release expected by July 27, 2026.
  • Kimi K3 achieves an overall Elo of 1547 in long-horizon knowledge work evaluation, significantly outperforming its predecessor Kimi K2.6.
  • The pricing for Kimi K3 is set at $3 per million input tokens and $15 per million output tokens, making it the most expensive model released by a Chinese AI lab to date.
Read original article

Community Sentiment

Mixed

Positives

  • The gap is closing — Kimi 3 is only 3 months behind the US model, signaling progress in AI capabilities.
  • Fable still reigns supreme for complex animation tasks, showcasing the high bar for creativity in AI models.
  • Gemini 3.1 Pro is noted for its visual creativity, despite some limitations, indicating strong potential in AI design.

Concerns

  • Benchmarks are losing credibility; experienced users express skepticism about their relevance for frontier models.
  • Concerns arise that if pelican SVGs were part of the training data, the model should perform at a higher artistic level.
  • Some commenters doubt the utility of benchmarks altogether, suggesting that models like Sol lack the creativity and 'taste' expected from advanced AI.

Related Articles

Qwen3.6-35B-A3B on my laptop drew me a better pelican than Claude Opus 4.7

Qwen3.6-35B-A3B on my laptop drew me a better pelican than Claude Opus 4.7

Apr 16, 2026

DeepSeek V4—almost on the frontier, a fraction of the price

DeepSeek V4–almost on the frontier, a fraction of the price

May 1, 2026

Gemini 3 Deep Think

Gemini 3 Deep Think drew me a good SVG of a pelican riding a bicycle

Feb 14, 2026

An open-weights Chinese model just beat Claude, GPT-5.5, and Gemini in a programming challenge - ThinkPol

Kimi K2.6 just beat Claude, GPT-5.5, and Gemini in a coding challenge

May 3, 2026

[AINews] Why OpenAI Should Build Slack

OpenAI should build Slack

Feb 14, 2026