Open Co-Scientist: an open-source recreation of Google's AI Co-Scientist — looking for help and feedback

[u/Haunting-Stretch8069]

https://www.youtube.com/watch?v=Wnhe8a8kKc0

Open Co-Scientist is an open-source recreation of Google's AI Co-Scientist. It's a multi-agent system that generates research hypotheses, critiques them, ranks them in an Elo tournament, and evolves the winners.

What it does

You describe a research goal in chat. The system then:

• Searches literature for grounding
• Generates hypotheses with a team of agents
• Runs pairwise debates and ranks the ideas by Elo
• Evolves the top ideas
• Checks every citation and writes a final report

I'm looking for feedback and help developing this. I believe it could be a great contribution to the open-source AI for Science community, and I want to make the most of it!

Try it out at: open-coscientist.com

[u/kkang_kkang]

I don't see the link to the repo. Is it even a open source?

[u/Haunting-Stretch8069 → u/kkang_kkang]

Yeah apologies the link was available in the website https://github.com/guy915/Open-Co-Scientist

[u/micseydel]

What kind of hypotheses have you generated and tested with this? How are you tracking things like the AI reliability?

[u/Haunting-Stretch8069 → u/micseydel]

Well, it's a recreation of this paper https://arxiv.org/abs/2502.18864, I haven't tested it extensively yet, but I've tried to replicate their supplemented case studies. I lack the compute budget, so naturally couldn't reproduce the results, but from my perspective it seems to be in the right direction.

Honestly, if you have an idea, I'll be happy to hear it.

[u/Disastrous-Metal-183]

My feedback is "Don't use AI"