High-quality benchmarks are being designed to assess cognitive abilities of frontier models, focusing on reasoning, acting, and judgment rather than just recall. These benchmarks aim to measure progress toward artificial general intelligence (AGI).

A set of ten research-level mathematics questions has been created to evaluate the capabilities of current AI systems in providing correct answers. The answers to these questions are known to the authors but will remain encrypted temporarily.