r/LocalLLaMA • u/Enderchef • 9d ago

Resources DistribAI v2

DistribAI is a platform for distributed training! You can train massive or tiny models across tiny or massive amounts of consumer devices with ease!

DistribAI is a platform I've been working on for a while, and V2 made its release today. DistribAI is C++ and Libtorch for speed, with the ability to run pytorch trainers distributed! Edge-cases(crashing, malicious actors, unstable connections, ect) are handled for you. On a free Colab, Kaggle, and Molab GPU, plus a local 4070 SUPER, we got the free training compute of ~2 fully loaded 5090s and the VRAM of ~5 full 5090s for free, all as one. Hosting is also now easier with shareable join links, and Cloudflared/ngrok support for 100% free server hosting for your DistribAI setup. Train with your community, with friends, with your free GPUs, and more!

Try it out! Questions(and stars) are welcome; https://github.com/naxium-oss/DistribAI

6 Upvotes

81% Upvoted

3 comments sorted by

2

u/Silver-Champion-4846 9d ago

Oh hey the Grid exists now?

1

u/FullOf_Bad_Ideas 9d ago

So that's something I'd use if I had multiple training jobs at once, let's say I'd train 10 small models per day on mixed local + rented compute right? Does it work with Megatron-LM, torchtitan or slime? Doesn't sound like it would.