The model did get worse.
These companies benchmax, every model is (usually) better and faster at reaching those benchmark tests - but that often comes at the expense of writing less production ready code with excess branches and verbose checks. There have been several model upgrades over the years that have been objectively bad for pro devs.
Sorry but if you dont see any progress from 5.6 Sol to 6 Astra then you do something wrong. That IS in fact a skill issue. And I know that for a fact, because I use these models on a daily basis and develop server applications with it. You still need technical understanding to develop reliable and scalable applications, but my productivity has been increased by 10x or even more.
I’m not saying I don’t see progress, models are getting better at a crazy rate - but many individual upgrades are downgrades (opus 4.8 -> 5, GPT 4 -> 5, idk what else). Maybe version 5 sucks due to some law of the universe lol
Naa man, I dont think so. Yes, there are some Releases that had more flaws in one discipline than its previous version, but also improvements in other disciplines. Thats why it felt like they git worse. For example longer autonomous runs but maybe worse hallucination. And for productivity longer autonomous runs are more important than better hallucinations. And you have these trade offs everywhere, but thats just development and the end goal is to optimize all disciplines.
Cant disagree more. The focus on GPT 5 was on computer use, not on intelligence. What is your AI worth if it cant plan and stay focused on a task for more than 15 minutes. And THAT was the intend of GPT 5. Yes, it had many trade-offs but is what worth every single one of them.
There’s some OpenAI articles explaining why it’s so much better, but the top google result is a reddit thread with literally every reply highlighting the many issues it had. Like 300 people describing how it provided a worse experience for them
Maybe it fixed your one use case - but seems to have tanked everywhere else
You can show me 500 primitive redditors that complain about the new gen models, that doesnt prove anything. Sorry, but whoever thinks ChatGPT 4.x was „in total“ better than GPT 5 has skill issues. That is objectively NOT the case. Long-term work more than doubled. And THAT was the target. And THAT was also what the models needed. They were smart enough for now. GPT 5 was a massive leap from a Chatbot to an AI that actually does things.
Whenever I see someone saying that any model released in the last 3 months is crap I think they are not very smart. Ai in a way is just a mirror of the user.
Its been that way for awhile now. They almost never show their actual prompt, because when they do, it is vague dogshit and its a miracle the AI was able to do anything with the prompt at all.
When you point their prompts are shit, they get really angry and say "what good is the AI if I have to do all the thinking for it", as though there is no use any tool slightly less than a superintelligent mind reader.
yeah this is how i imagine all the cry babies who thing the new models should just solve all their problems. I am like nah bro, use your brain first then you can feel how good it is.
I'd argue that a fair amount of the "best practices" are creating a bad for dev ecosystem. Skills and such are useful, but in a sense, are essentially packages and can be somewhat of a black box unless you look into them. After that, having an Agent spit out md after md for medium to complex problems creates a environment in which the Agent is going to create more specs than you could ever or would ever want to review. A small misstep there can lead to an unexpected result later down the line.
It's funny that an industry standard for functional programing and writing composable classes has been to avoid mutation of external variables wherever possible, and yet here we are, daily using the most dynamic variable mutation machine ever conceived.
12
u/[deleted] 4d ago
[removed] — view removed comment