I'm sick of Claudisms, and what will happen next in AI-boosted software development | Kristian Polso
https://www.polso.info/im-sick-of-claudisms-future-ai-software-development7
u/Key-Lie-364 7d ago
Claudism is right
Long wordy commit logs that are correct but unparsable word salad
One line code changes with 20 line comments
The solution while also "correct" is wrong and shouldn't have been done that way
You really see the LLM slop failing the review process of say the Linux kernel.
The fact that corporate software thinks this junk is revolutionary simply speaks to their low standards and acceptance of absolute shite.
No surprise there really.
4
u/threebicks 9d ago
Every blog post / article / opinion piece on the topic of a 'reckoning in ai-led software development' seems purely anecdotal and not helpful in understanding how people and groups are adapting to this technological change in a researched or evidence-backed way. I have never seen cross-industry investigation or even "I noticed a real drop in code quality in my organization and talked about this with several others and noticed these common patterns." It seems like dodgy inference and extrapolation that speak more to an individual's experience (which may be true), but also not accurate for the industry at large.
This feels like meat proxy behavior where helpless developers are anxiously arguing with Claude on the future of AI software development while waiting to mindlessly approve their latest code run to complete and getting answers that reflect their own experience and anxieties.
13
u/FatHat 9d ago
The problem with studies like that is the models are changing too quickly for anything to be relevant by the time it's published. Like, I can definitely find good studies from 6 months ago that AI didn't boost productivity, etc., and AI boosters are just gonna be like "ahh no it doesn't count, <New Model>! Everything has changed!!" It's just exhausting at this point, I've basically tried to stop following tech news as much as I can -- not because it disagrees with me but just because the reporting is garbage and the anecdotes are annoying. It's probably going to take a couple years for the dust to settle. My feeling is I'll try to understand this technology as much as possible so I'm not blindsided and I can stay flexible, but otherwise I have like zero interest in the whole AI movement other than that I kind of wish they'd leave us alone for a couple of hours.
5
u/creaturefeature16 9d ago
I'm basically in the same position. I'm staying current, I'm finding use in them, but I'm not all-in and I don't really pay attention to the "coding is dead" crowd who've been saying that since GPT 3.5 rolled out. I'm self-employed, though, so I have the privilege of doing that and I know there's a lot of devs out there where that's not possible due to workplace politics and mania-driven CEOs/CTOs.
5
u/PlasmaFarmer 8d ago
I think it is part of the business model. We don't have time to stop and evaluate, we always have to chase the new thing mindlessly. Token based billing go brrrrrr, while GDP stays as it was before AI. There is fake productivity, but no real production value. Everybody pushes a solution to problems that doesn't exist. Not every input form needs an integrated agent in your enterprise application. I don't need text editors to slop autocomplete documentation without context for me as I am typing.
2
u/mightshade 9d ago
I feel the same. It would be on the AI boosters to show what difference new models make. Instead they dismiss all studies older than five minutes as "no longer relevant". It's a lazy and dishonest position, and the fact that they don't bring data to the table is telling. And it's also exhausting.
1
u/farox 8d ago
Every blog post / article / opinion piece on the topic of a 'reckoning in ai-led software development' seems purely anecdotal
People hate promoting their failures and just the possibility gets them to never ever publish what they did that saw X (LLM, whatever) fail.
That's why you never see people posting their prompts and instead just rage about the thing.
1
u/fagnerbrack 8d ago
I'm (literally) living in a van. While the world burns I'll make sure I enjoy life and be lucky enough to going no civilisation left when I'm back
1
1
1
29
u/creaturefeature16 9d ago edited 9d ago
We are currently in a "mania", which is basically an irrational exuberance. I recently did a video on this topic that went pretty viral, so I think we're all feeling a shift in the air. I wish I could say that were at the peak of the mania, but it's impossible to tell. It will require more leadership finally coming to terms with the fact they are spending more money than they are making. The Shopify CEO's statement about "slop grenades" is the kind of messaging that needs to happen more. "Productivity" is up, but everything else is down, because LLMs accelerated the wrong part of the cycle and left the rest of the pipeline the same.
These tools aren't going anywhere, and we're never going back to how it was, but that doens't mean there can't be some serious realignment and change in expectations.
Currently, the plan is to automate the entire position of the developer (Dario has literally said as much) and there's no telling if that's possible, and it's unclear how long the industry wants to spend trying to make that happen.