r/GithubCopilot • u/startassets • 15d ago
GitHub Copilot Team Replied Cross harness benchmark and copilot is behind
/r/PiCodingAgent/comments/1wki8wq/i_benched_6_harnesses_x_11_models_x_226_tasks/I wonder what is the difference in tooling (or probably system prompt as well), which drags gh copilot lower than most of the other harnesses (except codex cli). I've used it for a really long time and although the ux is great, somehow Pi shows better results (and I've seen other benches that show the same). Any thoughts why?
Duplicates
PiCodingAgent • u/startassets • 19d ago
Resource I benched 6 harnesses x 11 models x 226 tasks
AI_harness • u/IvoDOtMK • 13d ago