Artificial Analysis Intelligence Index v5

Commenters spent far less time celebrating a new intelligence index than interrogating the machinery behind its reshuffle. The headline result was a conspicuous drop in several open-weight models alongside modest gains or smaller losses for prominent proprietary US models, which many readers saw as too patterned to dismiss. They wanted a concrete account of which benchmark weights, scoring changes, and model removals produced the movement, especially because earlier revisions were remembered as similarly punishing open releases. The addition of unreproducible private data and the disappearance of some popular open models from charts made the ranking feel less auditable, not more authoritative. Skeptics also argued that tiny benchmark suites, saturated tasks, and composite weighted scores can turn statistical noise into decisive-looking rank changes. Several users said their own backend, UI, and agentic coding work contradicts the new ordering: some open models are faster, cheaper, and less error-prone in daily use than their index position suggests. Others offered a less conspiratorial explanation: coding-focused models may genuinely lag on broader non-coding tests, and the coding-only ranking appeared more believable. A claim that an external coding benchmark used favorable vendor-specific agents was corrected; the index runs that evaluation through its own harness. Even so, the broader demand remained simple: publish enough methodology and coverage to make dramatic revisions independently credible.