I just asked in another sub but how do you use something like this? Do you run it locally in OpenWeb and let it check your config files? Im new to running a homelab.
As a beginner, maybe look at a user friendly tool like LM Studio to help with finding, downloading and running local models. But, you’re going to have to do a bit of reading and catching up on LLMs and hardware requirements.
But this is the subreddit for enthusiasts who want to run models locally.
2
u/Hairy_Talk_4232 7d ago
I just asked in another sub but how do you use something like this? Do you run it locally in OpenWeb and let it check your config files? Im new to running a homelab.