Why we no longer evaluate SWE-bench Verified
February 23, 20262 views1 min read
SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.
Share:
Источник: OpenAI Blog
Related News
AI
Neural NetworksOpenAI Releases GPT-5
OpenAI released GPT-5, a new AI model with improved capabilities in text generation, mathematics, and programming.
4h ago66
AI
Neural NetworksCursor capitalizes on GitHub frustration, launches rival hosting platform
6h ago17
Neural NetworksRobin Williams’ Instagram account brought back to fight ‘AI abuse’
8h ago12