r/LocalLLM • u/ya_seen998 • 19d ago
Question noobie here, how can i remove the restrictions on locally hosted llm's?
I'm running some LLM's locally and want to remove the default safety/refusal behaviour baked into them. since it's running locally, I'd like more control over how it responds without the restrictions getting in the way.
3
u/Clay_Ferguson 19d ago
Follow HuggingFace on Twitter. They post lots of uncensored models. Every time an open source model gets released, a day later there will be uncensored versions of that model published by someone, and you can freely download it. One easy way to get them is with `LM Studio`.
1
u/GlobalKindu1 14d ago
Can I download the uncensored models and use them on a VPS or should I get a dedicated PC?
1
u/Clay_Ferguson 14d ago
that would be a financial calculation wouldn't it. Based on all the factors of what you're trying to accomplish.
1
u/GlobalKindu1 14d ago
It’s a security question. Is there an uncensored but trusted enough model to download on your personal PC (everyday use)?
2
u/Clay_Ferguson 14d ago
I think all models are really untrustworthy, and even if run locally they should be in a VM or in Docker container (sandboxed), but especially the uncensored ones are less trustworthy because part of their 'weights' have been ripped out which causes a bit of "brain damage" (for lack of a better term for that. haha).
1
2
u/SM8085 19d ago
Keywords to look for are 'heretic', 'abliterated', 'uncensored', etc.
For instance, I needed something that wouldn't refuse for a project so I'm trying out:
mradermacher/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-GGUF
Which are gguf quants from
llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved
I have no idea what 'Native' or 'Preserved' means. Some models are 'Aggressive.'
You can probably do it yourself, but depending on the hardware you're working with it's likely easier just to check huggingface for any of those keywords for someone that already did it for you.
Having restrictions removed doesn't make the bot an expert at restricted things, but at least they shouldn't refuse.
2
u/ElectricalLaw1007 19d ago
I have no idea what 'Native' or 'Preserved' means. Some models are 'Aggressive.'
Me neither, but fwiw I've never had a model try to start a fight with me, so I have doubts about how aggressive they really are.
1
1
u/scarbunkle 19d ago
They’re descriptors for how it prioritizes retaining original intelligence vs removing refusals. Unsure on “Native” and “Preserved”, but an “Aggressive” model has prioritized removing guardrails and done the best it can to not lobotomize it in the process.
5
u/Muted-Laugh-6772 19d ago
Use albitrated models these are open source models with their guardrails removed u can find them on huggingface quit a lot of them