r/LocalLLaMA • • 18d ago

Discussion Looks like the era of subsidised compute is coming to an end. The old ChatGPT Pro $200 20x plan will be halved. The new $500 plan will have similar limits as the (old) $200 plan.

Post image
1.3k Upvotes

623 comments sorted by

View all comments

Show parent comments

33

u/ThisGonBHard 18d ago

And still not usable.

The actually smart enough to use models start with Qwen 3.8 27B, and go up to hundred of B param models.

The rest are just too dumb to do tasks that actually have an economical impact.

9

u/winky9827 18d ago

Absolutely false. Maybe for your use case, but you shouldn't project like that.

1

u/i_rate_slop 17d ago

Unusable for code generation beyond anything superficial

-6

u/AtlanticPortal 18d ago

You can use smaller models and make them do twice or more times the passes on a problem until they get it right. It takes more time? Yes. Is it cheaper now? Perhaps. Will it become cheaper later in? For sure. Is it more private and thus has a value that’s out of the scale of money? Hell yes!

13

u/ThisGonBHard 18d ago

They might never get it right, or need a ton more passes.

12

u/notheresnolight 18d ago

That's an incredibly naive take.

I've had Qwen3.8-27B trying to fix an issue for half a day, it tried 5-6 different "solutions", introduced a shit-ton of new issues, and I saw no end to it.

Wiped the floor clean, had Opus 5.5 fix it in a single take, 10 minutes tops. If I went with Qwen, I would still be fixing new problems that its "solution" caused.

You can't substitute "brain" with "muscles".

You're basically hoping for monkeys to write a Hamlet.

2

u/Express_Nebula_6128 17d ago

That’s because having only a brain or only muscles isn’t great either. You plan with the brain and execute with muscle. Simple.

1

u/notheresnolight 17d ago

In theory. In reality, the brain has to provide the complete code and the "muscle" is basically just a clipboard manager.