ai-architecture
Latest stories covering ai-architecture, with summaries and links to related coverage.
4 articles · page 1 of 1
Connected topics
Kimi K3 Architecture Overview and Notes
tool
2 min read
The Kimi K3 architecture is a scaled-up production version of the Kimi Linear model, increasing from 48 billion parameters to 2.8 trillion parameters. A new component in Kimi K3 is the LatentMoE, which enhances its capabilities as the largest open-weight model currently available.
Kimi Linear: An Expressive, Efficient Attention Architecture
research
2 min read
Kimi Linear is a hybrid linear attention architecture that outperforms full attention in short-context, long-context, and reinforcement learning scenarios. It utilizes Kimi Delta Attention to achieve this efficiency.
Apple reveals new AI architecture built around Google Gemini models
news
1 min read
Apple announced a new AI architecture built on foundation models developed in collaboration with Google, utilizing technologies from the Gemini family. This architecture is designed to operate on-device and on servers through Apple's Private Cloud Compute infrastructure.
I still prefer MCP over skills
opinion
9 min read
The AI community is advocating for "Skills" as a standard for enhancing LLM capabilities. The Model Context Protocol (MCP) is presented as a more effective architectural choice for providing LLMs with access to services compared to Skills.