The Kimi K3 architecture is a scaled-up production version of the Kimi Linear model, increasing from 48 billion parameters to 2.8 trillion parameters. A new component in Kimi K3 is the LatentMoE, which enhances its capabilities as the largest open-weight model currently available.

Kimi Linear is a hybrid linear attention architecture that outperforms full attention in short-context, long-context, and reinforcement learning scenarios. It utilizes Kimi Delta Attention to achieve this efficiency.

Apple announced a new AI architecture built on foundation models developed in collaboration with Google, utilizing technologies from the Gemini family. This architecture is designed to operate on-device and on servers through Apple's Private Cloud Compute infrastructure.

The AI community is advocating for "Skills" as a standard for enhancing LLM capabilities. The Model Context Protocol (MCP) is presented as a more effective architectural choice for providing LLMs with access to services compared to Skills.