Astra has also set the top score on our newest math benchmark, FrontierMath Erdős, which consists of 68 unsolved and especially interesting Erdős problems curated by @thomasfbloom. AI systems are tasked with writing solutions in Lean, a special-purpose programming language for automatically verifying mathematical proofs.

No prior model solved any of the problems, but Astra solved 2/68, scoring 3%. See our post introducing the benchmark for more details, including our open-source scaffold.

https://t.co/iJ7qrrg3UF