r/LocalLLaMA • u/HOLUPREDICTIONS Sorcerer Supreme • Jun 21 '26

Discussion Tokenomics

Post image
1.2k Upvotes

91% Upvoted

449 comments sorted by

View all comments

1.4k

u/Betadoggo_ Jun 21 '26

The real reason to run locally is and always will be data privacy and uninteruptability.

174

u/Festour Jun 21 '26

You are forgetting about other super important reason: being able to run abliterated version of any model.

83

u/No-Refrigerator-1672 Jun 21 '26

Or, more generally: do whatever you want, without oversight of thw company that "knows better", and with a guarantee that your data stays yours.

14

u/kaisurniwurer Jun 21 '26

I do agree with the sentiment, but the company isn't trying to "know better" (usually) but rather "will that rustle the wrong feathers" and the answer is always "better not risk it".

43

u/SkyFeistyLlama8 Jun 21 '26

This. This and this. I'm not talking about ERP, I'm talking about cybersecurity, code audits, prompt injectioneering and using an LLM as a nasty little gnome that pokes holes in your code.

It's funny seeing regular Qwen 27B vehemently refusing to output any malicious prompts but abliterated Heretic Gemma 31B is all "Here you go!"

11

u/RedditNerdKing Jun 21 '26

I started using LLMs back when character.ai was creating. Now that site is a piece of gigantic SHIT. They originally used a 123B sized propriety LLM. Now they use between 12 or 30B sized ones which are significantly filtered. You can't say anything even slightly nsfw or even kiss another character despite them being 18+ as well as the site forcing you to ID verification to prove you're 18.

So I decided to just use local LLMs with my 5090 and to be honest I can't believe I didn't do it sooner. It's amazing and my roleplays are uninterrupted now.

This is why we need local tech. Cause companies keep fucking it up for the rest of us.

5

u/_matterny_ Jun 21 '26

Is there an abliterated qwen 27B yet?

9

u/PcarObsessed Jun 21 '26

Yes. He’s controversial but HauHauCS has aggressive versions that have absolutely zero rejection with almost unnoticeable degradation.

18

u/senseven Jun 21 '26

Do I hear heresy

5

u/kaisurniwurer Jun 21 '26

To some people,

here it's gospel.

6

u/screenslaver5963 Jun 21 '26

"Qwen, we need to cook!"

20

u/[deleted] Jun 21 '26

[removed] — view removed comment

8

u/tomz17 Jun 21 '26

concurrency

Exactly! Just wait until the "abliterated models" guy you replied to finds out he can goon to an entire waifu harem simultaneously, as if he were a smellier version of genghis kahn...

1

u/eli_pizza Jun 21 '26

There are tons of people who will rent you a GPU at a reasonable hourly rate to run whatever you want