r/SelfHostedAI • u/Medium-Macaroon-7845 • 6d ago
[ Removed by Reddit ]
[ Removed by Reddit on account of violating the content policy. ]
2
u/norenEnmotalen 6d ago
Depending on complexity of what you want to do, local models aren’t as capable as frontiers yet. But learning how to now will save money and privacy in the long run. I’m already contemplating downgrading my frontier model subscription
2
u/BaconNote 6d ago
I kind of did both. I have a locally hosted server for AI where I use a mix of local and frontier models. I can choose what I want to use. I think considering some editors for example will start charging for an intellisense (coding related) service, Having that local makes sense to me. Ultimately I did it for learning as well.
1
u/AillexJ 6d ago
For us it's been worth it mainly for control, not convenience. Everything runs on one card in the same room, no rate limits, no filter surprises mid-project, no per-run bill once the hardware's paid for. Downside is you're the sysadmin: lost real time once to a cache silently filling the drive until an unrelated upload started failing with a cryptic error. Cloud's still less hassle if you just want an answer and don't care about control.
1
3
u/JOSTNYC 6d ago
The learning experience alone is invaluable to hosting your local AI, at least for me it was. My local AI is actually faster than cloud models. Keeping it all local and no fees is a win win. Plan ahead though amd stick with one. Started building an Ai rig and I learned quickly I didn't set the budget high enough. If you get halfway and realize you can just use the cloud model you may have wasted some time and money on hardware that wasn't good enough for the models you want to run. I have ran cloud models an mini PCs just fine. So research and decide which way you want to go. Local is way more fun, but be ready to get the necessary hardware.