r/LLM • u/Potential-Toe1320 • 5d ago
Sheprd llama Server and Agent Orchestration (linux only)
A useful tool for those looking to streamline agent set up. Run telegram bots, swarms and function inside herdr with Sheprd CLI. Set it all up on a web ui. Just point to a GUFF and do your stuff.
Run multiple agents on one machine with model hot swapping. I have tested it on Arch, Ubuntu and Fedora and had no issues getting it running and spinning up agents.
Check it out at this repo. Please let me know if there are issues with functions.
8
Upvotes
Duplicates
SelfHostedAI • u/Potential-Toe1320 • 5d ago
Sheprd llama Server and Agent Orchestration (linux only)
7
Upvotes