Real-SWE: Benchmarking AI models on private, real-world, enterprise codebases

Introducing Real-SWE Benchmarking frontier AI models on private, real-world, enterprise codebases. 01Introduction Today we are releasing Real-SWE, a benchmark that evaluates frontier AI models on private, real-world, enterprise codebases. Each task comes from a private production codebase that we licensed from a real-world company. These are problems their engineers work on, with all the context a...