Separating signal from noise in coding evaluations
A new analysis from OpenAI reveals issues in SWE-Bench Pro, a popular coding benchmark, raising concerns about reliability and accuracy in evaluating AI models.
原文：https://www.a8q9.cn/en/article/separating-signal-from-noise-in-coding-evaluations-705f1a.html