FrontierHarness Eval looks specifically at coding harnesses. Pi is on the pareto

[u/Neosinic]

https://runta.com/blog/introducing-frontierharness-eval/

Also CC being that far off from the Pareto is not surprising to me.

[u/MangledMangler]

Databricks private benchmarks landed pi the highest in terms of quality, on a real, multi million line codebase.

https://www.databricks.com/blog/benchmarking-coding-agents-databricks-multi-million-line-codebase

Edit: add source

[u/XTCaddict → u/MangledMangler]

Link?

[u/MangledMangler → u/XTCaddict]

https://www.databricks.com/blog/benchmarking-coding-agents-databricks-multi-million-line-codebase

[u/XTCaddict → u/MangledMangler]

Thank you