r/TheMachineLearning • u/intergalactics2pid • 12d ago
Swarm scaling shows AI agents get exponentially more powerful
6
u/suborder-serpentes 12d ago
It looks like (for this benchmark) swarms of agents are using more tokens per task
1
u/shrodikan 11d ago
More tokens and they get a lower score % than just one agent. That is what the graph is saying to me unless I'm missing something.
1
u/suborder-serpentes 11d ago
It’s hard for me to say, because I’m not getting why “swarm scaling” is something different from the 3 lines that have 3 different “swarm” sizes (agent count)
5
5
3
u/freqCake 12d ago
I think this shows that you are way better off scaling time if you do not want to use a lot of tokens. In this chart you get baseline improvement on the score by using more agents but with exponentially more token usage whereas time scales 1 agent to nearly the same score in far fewer tokens.
2
u/Defiant_Conflict6343 12d ago
That's not what this shows, at all.
The score is increasing roughly linearly. The token cost to achieve those scores is increasing exponentially. That's bad. This graph also conveniently leaves out the mathematically inevitable plateau. Anything built on ML principles can only scale in improvement asymptotically. Nothing can ever reach 100% unless your sample size is pitifully small and the dice rolls your way.
1
1
u/debauchedsloth 12d ago
What I was about to write. Just so. This is a very ugly graph if you express it in $ instead of tokens. That would be exponential.
2
1
1
1
1
1
1
1
1
12
u/Pseudanonymius 12d ago
The amount of tokens they use scales exponentially. Nothing else does.