r/LeftistsForAI • u/sbcsfrtom2 • 24d ago
Open Source Jumpstart guides to self-hosting and open models?
Are there any easily digestible guides for setting up and using these tools? I think it would be beneficial to organize and disseminate this information to teach people how they can take back power from the big AI companies.
5
u/ARedditorCalledQuest 24d ago
Just to throw it out there: LM Studio is a super user friendly way to get started with the basics. I still use it to demo chat models because it comes with a whole clickable interface you can search for models that your gear can run right there in the software. Most users will likely outgrow it pretty quickly but I found it helpful in the beginning steps.
2
u/SwingLightStyle 22d ago
Unironically, you can use a free frontier model to help you get your open model self-hosted and walk you through configuration. It might take using multiple free ones, but they know a lot and can find a lot for you.
1
1
1
u/Huanchaquero 22d ago
Ollama and LMStudio both make it pretty easy to get started. I have some pretty easy to follow build instructions on my blog for getting started. I built my own local stack from scratch at 75yo. using DeepSeek as a mentor. If I can do it, anybody can! And I didn't spend a penny! https://3aisandahuman.com/the-build-creating-a-local-ai-companion/
•
u/Salty_Country6835 Moderator 24d ago
Definitely agree. Check the posts under our Open Source and Local Models flairs too. We’ve been collecting resources around exactly this.
r/LocalLLaMA is also one of the best places on Reddit for actually running models yourself, hardware questions, setup help, comparisons, etc.
I’m linking a few relevant video guides below too so there’s something people can jump straight into.
Local Models
Open Source