Kimi Linear: An Expressive, Efficient Attention Architecture
Kimi Linear is a hybrid linear attention architecture that outperforms full attention in short-context, long-context, and reinforcement learning scenarios. It utilizes Kimi Delta Attention to achieve this efficiency.
arxiv.org
🔥🔥🔥🔥🔥
2 min
11h ago
Kimi Linear: An Expressive, Efficient Attention Architecture
Kimi Linear is a hybrid linear attention architecture that outperforms full attention in short-context, long-context, and reinforcement learning scenarios. It utilizes Kimi Delta Attention to achieve this efficiency.
arxiv.org
🔥🔥🔥🔥🔥
2 min
11h ago
Kimi Linear: An Expressive, Efficient Attention Architecture
Kimi Linear is a hybrid linear attention architecture that outperforms full attention in short-context, long-context, and reinforcement learning scenarios. It utilizes Kimi Delta Attention to achieve this efficiency.
arxiv.org
🔥🔥🔥🔥🔥
2 min
11h ago
No more articles to load