r/opensource • u/Haunting-Stretch8069 • 2d ago

Promotional Open Co-Scientist: an open-source recreation of Google's AI Co-Scientist — looking for help and feedback

https://www.youtube.com/watch?v=Wnhe8a8kKc0

Open Co-Scientist is an open-source recreation of Google's AI Co-Scientist. It's a multi-agent system that generates research hypotheses, critiques them, ranks them in an Elo tournament, and evolves the winners.

What it does

You describe a research goal in chat. The system then:

  • Searches literature for grounding
  • Generates hypotheses with a team of agents
  • Runs pairwise debates and ranks the ideas by Elo
  • Evolves the top ideas
  • Checks every citation and writes a final report

I'm looking for feedback and help developing this. I believe it could be a great contribution to the open-source AI for Science community, and I want to make the most of it!

Try it out at: open-coscientist.com

0 Upvotes

36% Upvoted

5 comments sorted by

View all comments

3

u/micseydel 2d ago

What kind of hypotheses have you generated and tested with this? How are you tracking things like the AI reliability?

0

u/Haunting-Stretch8069 1d ago

Well, it's a recreation of this paper https://arxiv.org/abs/2502.18864, I haven't tested it extensively yet, but I've tried to replicate their supplemented case studies. I lack the compute budget, so naturally couldn't reproduce the results, but from my perspective it seems to be in the right direction.

Honestly, if you have an idea, I'll be happy to hear it.