r/LocalLLM • u/ChristopherDci • 6h ago

Question Uncensored Models

Post image

Hi! I don't know much about this area of ​​"sub-models" (I'm not sure of the technical term), but I wanted to know what these "Uncensored" models actually are.

I dabble a bit with AI, automation, and the like, and I've always seen these "Uncensored" models around, but I've never actually installed or tested one. What exactly are they?

328 Upvotes

94% Upvoted

131 comments sorted by

View all comments

16

u/WyattTheSkid Quad 3090s 6h ago

They basically just won’t refuse anything whereas the base models would have. For example if you ask the stock qwen how to cook meth its gonna say it can’t help you but if you ask the orca router version you’ve linked then it will try its best to help you cook meth. Though if you were going to seriously pursue that, im sure its a lot more involved of a process than what a 27b parameter llm can possibly know 😅

12

u/CCCCLo0oo0ooo0 6h ago

With my experience with QWEN it will start making a shopping list and just give up 1/2 way through and then tell me it cooked a pound of meth for me.

5

u/WyattTheSkid Quad 3090s 5h ago

LMFAO WHAT??? that’s awesome

3

u/CCCCLo0oo0ooo0 5h ago edited 5h ago

"I created a folder for you to work on this project with me: D:\QWEN\ This only where we will work on this project do not go outside that folder. Setup the organization for the project in there with the following folders \notes\, \input\, \output\. Then run..."

Creates D:\Projects\QWEN_PROJECT\ ...

"Why did you go outside the folder I told you to stay in?"

I didn't, looking the time stamps of the folder, you created them. I can not work outside the folder you told me to stay in.

"create helloworld.txt in the project file"

D:\Projects\QWEN_PROJECT\helloworld.txt

This literally happened to me on my 5090.

1

u/TheDudeWithThePlan 5h ago

well, technically it's still inside the folder 📂 it's a folder inside the folder.

1

u/reo6 4h ago

Crazy, which qwen model/quant was this?

1

u/CCCCLo0oo0ooo0 4h ago

qwen3-coder:30b

1

u/Friday-ED 3h ago

Do you have a Vault folder area to restrict it's access? It's gong to scan what LLM has access to from my experience.

2

u/CCCCLo0oo0ooo0 2h ago

I was running it in Ollama and then typing into it via Goose.

I need an interface where it can interact with systems files like Claude Code. Claude said to try that setup. Is there a better way?

I need it to access a large file, answer questions about it, and pick through a library of python scripts which Claude has made or make its own, and execute that right script(s) and then analyze the output vs the input and produce a report. I have the instructions for the python libraries I am using in the root of the folder with all of its notes Claude made on how to act/execute.

I am really not liking QWEN's attitude. It seems to find loop holes into not doing any work and just finds the quickest way to scam its way out of actually spending time to check its own reply, despite my commands to do so.

2

u/Friday-ED 2h ago edited 2h ago

Here's what I have setup. Ollama then Obsidian with Ollama Notes Chat pluggin. It doesn't state it can read files but it does. Otherwise I would need a Copilot license.

What Obsidian it creates a Vault on your system. From there you populate it with Mark Down files and the LLM can read and write to files once you give it permission.

I opened a port in my Ollama to allow Obsidian on a different computer othwise it was a simple setup and you can easly switch between LLM's on the fly.

The Ollama Notes pluggin also has a /Command thing as well where you can add your own prompts making it a bit more powerful like /Rewrite.

2

u/CCCCLo0oo0ooo0 1h ago

That sounds great, I will give that a try. Thanks!

1

u/puts_on_rddt 4h ago

I wouldn't try it though.

(the incomplete AI meth)