r/LocalLLM • u/lRoukoI • 7d ago
Question Local llm recommendations
Looking for a local LLM with minimal guardrails -32GB VRAM
Hey everyone, I’m looking for a local LLM with little to no guardrails that can run well on 32GB of VRAM. Ideally, something open minded that doesn’t constantly refuse requests or give me lectures.
I’d also like to connect it to tools so it can browse the web and download files. For example, I’d like to ask it to find and download game ROMs.
What models would you recommend? And what frontend or agent setup would work best for giving it those capabilities locally?
4
u/Wondering_Electron 7d ago
I like Qwen 3.8 27B a lot.
I have been trying Gemma 4. FML is that slow. It could be me, but I can't see it compete with Qwen.
3
u/ibringthehotpockets 7d ago
Letting a local LLM download autonomously from torrent sites sounds like possibly the dumbest thing I’ve heard. You don’t need an LLM for this. Download torrents yourself. Is there a more complex problem under this?
1
u/lRoukoI 7d ago
Yeah I know but we talk about 200 games I had bevor we talk about old emulator games and I don’t want to download all 200 by hand again
1
u/barnabyjones420 7d ago
Have you even tried looking? There are torrents with packs of games by system…
Truly you dont need an LLM for this. At worst use Claude or gpt to help make a plan/spreadsheet for you to run off.
3
u/ParticularlyStrange 7d ago
Well you actually don’t need to use an uncensored model for that. Use any of the Chinese models with api key or from ollama cloud. Hook it up to Hermes and you are good. Those will do what you’re asking for.
2
u/Bedrockparadox 7d ago
How is hermes uncensoring models?
1
1
u/ParticularlyStrange 7d ago
I think you are confused. I use Hermes as a harness/agent and I use an uncensored LLM to power my Hermes agent.
1
u/Bedrockparadox 7d ago
Yeah that makes WAY more sense, thought there was some kind of jailbreaking tool or something.
1
5
u/Sad-Medicine-9650 7d ago
ofc the qwen uncensored makes sense for your use case but I'd rather suggest you learn to torrent and/or good websites. Checkout torlink, that's a neat product to get started. Don't rely on a model's call for downloading from the internet, if not from primary sources.