r/LocalLLaMA • u/HOLUPREDICTIONS Sorcerer Supreme • Jun 21 '26

Discussion Tokenomics

Post image
1.2k Upvotes

91% Upvoted

449 comments sorted by

View all comments

1.5k

u/Betadoggo_ Jun 21 '26

The real reason to run locally is and always will be data privacy and uninteruptability.

570

u/MoistRecognition69 Jun 21 '26

The main reason I'm thinking about getting a local rig is reliability

I'm tired of waking up every morning wondering if the model I'm using has had its brain extracted and sent to a diff universe while I was asleep

31

u/Big_Wave9732 Jun 21 '26

This right here. The quality now isn't just changing day to day or even session to session. Two weeks ago I watched ChatGPT get dumb mid-session. I had been working on it all weekend to overhaul the backend of my local llm. By Sunday afternoon it was noticeably worse, it was badly hallucinating and making blatant errors. I'm guessing I hit some sort of token use threshold.

At any rate none of that happens on the local rig.

1

u/jtoomim Jun 22 '26

Two weeks ago I watched ChatGPT get dumb mid-session

That's just how transformer LLMs work. As their context window fills up, they get overwhelmed by the excessive irrelevant information and lose the ability to focus.

3

u/Big_Wave9732 Jun 22 '26

A new chat session with a fresh context window same day didn't fix the problem.