When AI Benchmarks Break: The SWE-bench Verified Controversy
SWE-bench Verified, a major AI coding benchmark, has become contaminated with flawed tests and training data leakage, leading experts to abandon it for more reliable alternatives. This controversy highlights the ongoing challenge of accurately measuring AI progress in an rapidly evolving field.