Kimi Linear is a hybrid linear attention architecture that outperforms full attention in short-context, long-context, and reinforcement learning scenarios. It utilizes Kimi Delta Attention to achieve this efficiency.

An open-source model combined with proprietary task data and reinforcement learning has been implemented in various real-world scenarios. Bridgewater Associates utilizes AI to analyze a continuous influx of documents to determine their relevance to investment strategies.

Ring-Zero scales zero reinforcement learning (RL) to a trillion parameters, enabling emergent reasoning capabilities. This advancement addresses computational constraints that have limited previous studies in zero RL, which utilizes verifiable rewards without human-annotated data.

Training a single transformer layer can achieve performance comparable to full-parameter reinforcement learning (RL) training. This finding suggests that RL adaptation may not require uniform updates across all layers of large language models.

MaxProof is a framework designed for population-level test-time scaling in mathematical proof, specifically within the MiniMax-M3 series. It trains three key capabilities: proof generation, proof verification, and critique-conditioned proof repair.

Richard Bellman's 1952 paper established the foundation for optimal control and reinforcement learning. His later work in the 1950s connected continuous-time systems to a previously published physical result from the 1840s, formulating the optimal condition as a partial differential equation (PDE).

Tree Search Distillation utilizes Proximal Policy Optimization (PPO) to enhance language models by integrating a test-time search mechanism similar to that used in game-playing neural networks like AlphaZero. The method aims to distill a stronger, augmented policy back into the language model, addressing the limitations observed in previous attempts with Monte Carlo Tree Search (MCTS).

Chess engines like AlphaZero and lc0 use reinforcement learning by having the engine play itself multiple times to train the model on game outcomes. A combination of a weaker model and strong search capabilities can outperform a stronger model alone, as the search can significantly enhance performance.

Reinforcement learning from human feedback (RLHF) is a key technique for deploying advanced machine learning systems. A new book provides an introduction to the core methods of RLHF for readers with a quantitative background.