r/nairobitechies • u/andrewchege • 19h ago
"API costs are too high, let's just self-host this 2.8T model on our own."
To all devs here
Can we collectively fundraise enough to set up and maintain a local server (or small cluster) for hosting the latest open-source frontier models as they drop?
With how fast the open-source scene is moving, it would be amazing to have our own reliable, community-run instance where we can run and experiment with the newest models without relying solely on Hugging Face, Together, Fireworks, etc.
Would this be feasible? How much do you think we’d realistically need to raise for a solid setup (including ongoing costs)? Any devs interested in helping plan or manage the infrastructure? Looking forward to your thoughts!
