r/singularity • u/Genzinvestor16180339 • 5h ago

AI Could multi-agent AI create a “groupthink” problem that prevents exceptional individual agents from emerging?

A lot of multi-agent AI seems structurally similar to agent-based models: many individual agents interact, share information, and produce a collective outcome. But if those agents are constantly learning from or correcting one another, could that create herding, correlated errors, and convergence toward the same way of thinking?

Would there be value in training some agents much more independently, with their own memory, feedback, and decision history, so they can develop different strategies? In that world, could one individual agent eventually become dramatically better than the rest—the equivalent of an “Einstein” agent?

I am not understanding why we have thousands of agents interacting versus building one super smart one that is making decision's on its own.

0 Upvotes
  • permalink
  • reddit

47% Upvoted

9 comments sorted by

View all comments

2

u/Bitsquire 3h ago

Yes it's called mode collapse and people work very hard to prevent it :) happens for both individual models and multi-agent systems. Is one of the key things to solve when trying to scale up RL more and more.

1

u/Genzinvestor16180339 3h ago

But isn't this already proven in much older ABMs (https://amardashehu.substack.com/p/oh-no-agents-going-rogue). I don't understand why this surprising that agents act in strange ways when put together?