Context Language Models

Computer Science > Artificial Intelligence [Submitted on 29 Sep 2026] Title:Context Language Models View PDF HTML (experimental)Abstract:We introduce Context Language Models (CLMs), language models that natively manage their own context. We implement this by treating the context as a file and allowing the model to make unrestricted updates to this file. This allows the model to learn what is most ...