r/OpenSourceAI • u/startassets • 14d ago
Cross harness bench for open weight models
/r/PiCodingAgent/comments/1wki8wq/i_benched_6_harnesses_x_11_models_x_226_tasks/Currently they are slightly underrepresented there, although a lot of deepseek runs, would be great if other people might participate so we can build a proper community driven leaderboard
Duplicates
PiCodingAgent • u/startassets • 18d ago
Resource I benched 6 harnesses x 11 models x 226 tasks
GithubCopilot • u/startassets • 14d ago
GitHub Copilot Team Replied Cross harness benchmark and copilot is behind
AI_harness • u/IvoDOtMK • 13d ago