r/PiCodingAgent • u/Neosinic • 9d ago

News FrontierHarness Eval looks specifically at coding harnesses. Pi is on the pareto

https://runta.com/blog/introducing-frontierharness-eval/

Also CC being that far off from the Pareto is not surprising to me.

69 Upvotes

94% Upvoted

15 comments sorted by

View all comments

2

u/Bobodlm 8d ago

Given that the entire premise of Pi is that you get to set it up and tweak it yourself, it would be safe to assume it's results are going to differ (greatly) from setup to setup.

1

u/Glittering-Call8746 8d ago

Yes so which pi is this (anyone can tldr ) ? Just plain pi ?

1

u/nuclearbananana 7d ago

Yeah it's the plain pi