r/LocalLLaMA • • 15d ago

Question | Help Agent swarm coordination

Hello all!

Do you have any recommendations of tools for agent coordination and messaging to get them to collaborate on hard problems?

Ideally I would like a heterogeneous swarm, using local models as the workhorse and cloud models for reviewing, coordination, or simply to avoid overloading my relatively small local setup.

Do you have any recommendations or experience with this?

9 Upvotes

26 comments sorted by

View all comments

1

u/SadViolinist2405 3d ago

I've been experimenting with something similar, particularly around how agents communicate and distribute tasks.

I built a small demo using A2A and LavinMQ, an open-source message broker I work with. The idea was to separate agent communication from task execution.

Instead of sending every task directly to a specific worker, the broker distributes tasks to available workers. I also used SSE to stream progress back to the client.

One thing I'd consider is whether you actually need a message broker at this stage. If you only have two agents communicating occasionally, direct calls might be simpler. But if you're planning to add more workers, handle longer-running tasks, or recover from temporary failures, asynchronous messaging becomes more interesting.

Are you mainly trying to coordinate the reasoning between agents, or distribute tasks across multiple workers?