Outcome resources: Exactly where supplier figures usually are not obtainable we report figures from leaderboards reporting outcomes on these benchmarks: Humanity's Previous Examination success are sourced from and , LiveCodeBench final results are from (1/1/2025 - 5/1/2025 during the UI), Aider Polyglot numbers come from . Specifics originate from