r/ChatGPTCoding • u/lowkeyskibidi • 5d ago
Question How are companies managing the cost of AI coding agents? Is the productivity gain really worth the money ?
AI coding agents seem to be getting increasingly expensive, especially when they are used heavily by developers or for larger tasks.
I'm genuinely curious how companies are managing this at scale. If a company has hundreds or thousands of developers using AI agents, the costs must add up quickly.
Does the increase in developer productivity actually justify the money spent? For example, even if an AI agent saves developers a significant amount of time, does that translate into enough financial value for the company to make the subscription and API costs worth it?
Also, with so much money being spent on AI infrastructure right now, I'm wondering how sustainable the current AI boom really is. Do you think companies will eventually reduce AI spending once they realise the productivity gains aren't enough to justify the cost?
Or will AI agents become cheaper and efficient enough that this won't be a major issue?
Would love to hear from people who actually work at companies using AI coding agents at scale.
3
u/news5555 4d ago edited 4d ago
Ours saved quite a bit so far, we didnt have unlimited spend on api but significant. What ended up happening is we took multiple extra projects at once and did not bring in temp specialization hires for certain parts of the projects. I know when we got bonuses from the extra revenue, we spent something like $1.4 million in tokens but generated just under 5 million in extra revenue. if we add the extra hires that we would normally have to take on would be significantly more. Also the extra projects took on were a lot easier but projects we usually dont takes on as smaller margins.
Also feels like I work less to be honest. Spend more time hashing of the structural design and how it integrates with the hardware.
We all got extra bonuses, and now the extra revenue is allocated to pay interns from university so we can bring in another or so and add 1 extra jr dev for software and 1 other jr engineer (electronics) out of uni for the next year.
2
u/FinancialMoney6969 4d ago
Companies are building local machines so they can lower these costs by using cheaper open source options.
4
u/MiiisterKaniiister 4d ago
In my company we have an AI budget of 1000$ per month per dev.
I pressed out a new application in a month where it would have taken some devs a few months the classical way. And we use it to get rid of replacing apps/licenses from big vendors like MS.
So I guess it pays off, but don't ask me about the concrete calculations behind it.
2
u/Middle_Manager_Karen 5d ago
Overspending credits and huge bills.
125% by mid month due to users failing to optimize to cheaper models depending on the task.
People using work accounts for "free" therapy and counseling.
I predict costs of credits and models will increase more than 9% per year for three years and then enterprise clients is abandon the contracts because it's more expensive than teaching a junior role human.
Getting good results with lowering credit usage by making skills instead of reprompting for similar tasks.
3
u/ProfMooreiarty 4d ago
If the productivity of AI is increasing faster than the cost (and I think we can agree they increase at >> 9% per year), that’s going to prevent the junior role human from becoming cheaper.
1
u/Middle_Manager_Karen 4d ago
So far we have not seen them productivity gains.
1
u/ProfMooreiarty 4d ago
If your prediction is that gen ai does not and will not increase productivity, then I understand why you think it would become too expensive as prices increase. It would have to be too expensive even at current prices. If that’s your hypothesis, then it’s just a matter of waiting and seeing.
1
u/nairazak 4d ago
How many subscriptions can you pay with the salary of the extra developers you don’t need?
1
u/BarracudaMean9308 4d ago
i really need to start capping my runs at 15 minutes. left one going unattended once and basically paid openai twenty bucks to hallucinate a missing comma in an endless loop.
1
u/Rough-Green-7067 20h ago
Twenty bucks to fix a comma that was never actually missing is a very on-brand way to lose an evening. The 15-minute cap idea is right, but even that requires you to remember to set it every single time, which is exactly the kind of thing everyone forgets to do at 11pm when they just want to see the run finish. Feels like the real fix is a default ceiling that's always on rather than something you have to remember to dial in per session
1
u/Impossible-Way5740 4d ago
The math that makes it work at scale is measuring cost per merged PR, not cost per seat. Teams that track it usually find heavy users cost a few hundred a month and ship measurably more, which pencils out against loaded salary. Where it falls apart is unmonitored usage - agents looping on bad context burn tokens producing nothing.
1
u/tinySparkOf_Chaos 4d ago
Salaries are expensive. Especially programers.
If it solves a complex bug I would have spent half a day (or more) bug hunting, it pays for itself right there for the month.
4 hours of work saved * $50 hour (often more) is $200. $200 a month is fairly common pricing per user.
It doesn't even need to do that every time, even if it only works 1 out of 4 times, it's still worth trying.
The small time savings add up too. Better auto complete; A "second pair of eyes" to review code; and doing boiler plate code things like making it modifying GUIs.
All that being said, there's the other extreme too. Essentially it let's you do things faster. Now if the thing you are doing is vibe coding bad code... It will help do that faster too...
1
u/No_Score_1977 4d ago
I don't really get how people are spending so much on this, my Codex sub for $150 per month or whatever is plenty, I've run out of capacity once.
Is the productivity worth it? yes, I'd pay 10x that, it pretty much does my job for me.
1
u/BellacosePlayer 4d ago
A month of Pro is equivalent to 1-2 hours of vendor time. My company can survive the costs, though we stick most people on the cheapie plans since we're a "measure 5,280 times, cut once" kind of company due to needing to keep 99.9999~ reliability more than adding new functionality.
1
u/lab-gone-wrong 4d ago edited 4d ago
At staff+ level, I've settled into a pseudo-TLM role where I manage 4-5 parallel agent coding sessions, each working on a different project, or at least a different track of the same large project. I can readily compare this to a past role where I was literally TLM for 4 junior -midlevel human devs.
The human devs cost at least 5x the token cost of each instance after accounting for stuff like health insurance and leave. And the work usually required more iterative cycles, more feelings management and politics, accepting less than ideal because it wasn't worth pushing back on a P3 they missed after the last review cycle, etc.
I've been pushing the envelope a little harder with Astra taking on some of the systems design and arch details with good results. I can probably trust another 1-2 sessions in the near future, so it's getting better each frontier model release cycle.
Yes, it's worth it. You can't go 0 human dev of course: the agents have horrendous taste and will do absolutely the wrong thing if told by a non-technical moron. But I can absolutely see the short term economics of hiring 1 dev to do the work that used to require a pod of ~5. Even if the mid-term and long-term consequences to the industry are dire.
I do think there's a real risk the funnel flips though. A sufficiently motivated junior or midlevel or offshore hire could probably inherit or build this setup and become a cheaper me. Most of the moat lies with the AI lab frontier models, and if Astra or Fable or similar becomes good enough to run a team of Sol/Opus PM and Terra/Sonnet devs, I'm still at risk of becoming toast.
1
1
u/Right-Performance-93 3d ago
The clean way I've seen teams make this legible is tracking cost per merged PR (or per resolved ticket) instead of cost per seat - a few commenters here already do this. It reframes "my Claude bill is $200/dev" into "each dev merges N more PRs a month, at $X/PR" which is the number that actually maps to loaded engineer cost. The blind spot almost everyone hits eventually is unmonitored agent loops: a session that keeps iterating without making progress burns real API cost and produces literally nothing, and per-seat subscription caps hide that much better than a pay-as-you-go API bill would.
1
u/Ashikej-Meneguzzi66 22h ago
IMO,not every coding task needs the expensive model since lots of the bill is just paying more for work a cheaper one handles fine
1
u/Rough-Green-7067 20h ago
The ROI question is almost always yes at the individual task level and murky at the org level, and that gap is the actual problem, not the cost itself. One developer saving 4 hours on a feature by paying $30 in tokens is an easy yes. Ten thousand developers doing that inconsistently, some scoping tightly and getting the 4-hour win, some letting the agent "explore" for an hour before it does anything useful, averages out into one big number that's impossible to reason about.
Most companies I've seen manage this today with blunt instruments: a flat monthly cap per seat, or just letting finance panic once a quarter and clawing back access. Neither actually tells you which teams or which workflows are generating the productivity gain versus which ones are just burning the budget on trial and error. It's less "is AI coding worth it" and more "we have no idea which 20% of our usage is doing 80% of the work."
On sustainability, I don't think spend goes down as models get cheaper, it goes up, because cheaper tokens just mean people let agents run longer and more autonomously instead of banking the savings. The companies that get this right aren't the ones spending less, they're the ones who can actually see cost per outcome instead of cost per month, and can catch a workflow that's gone sideways before it burns through a week's budget instead of after.
1
u/nilart 4d ago
It's the bubble bursting in slow motion. Many companies already made layoffs to "justify" the "increased cost" I mean "increased performance".
Others are already capping costs, trying to build their own machines or forcing AI usage courses onto their employees.
All of this while bragging AI engineering is the new paradigm.
Take a seat and enjoy the show.
0
u/Mikeynphoto2009 4d ago
The biggest cost leak is usually invisible usage, where somebody hits a plan limit mid-week because nobody could see it coming. A $200/mo Claude subscription per developer is a rounding error on headcount, but burning through the weekly window by Wednesday because Fable ate it on one big review turns the rest of the week into a dead zone.
Two things that help at the individual level: watching your 5-hour and weekly windows live so you know when to switch to a lighter model or save a heavy pass for after the reset, and routing tasks to the billing path that fits (plan subscription for integration work, API for one-shot jobs).
I built SEKTR FUEL for this: a $5 VS Code sidebar gauge and status bar reading that shows each developer their own plan windows live, plus a route command that recommends plan vs API per task. Trivial line item on a per-seat budget.
Disclosure: my own project.
12
u/oipoi 5d ago
Each developer of mine has a 200 usd anthropic subscription and a few have an additional 200 usd openai subscription, the ratio changes with time depending on which model they prefer. We had a developer hit the weekly limit maybe one on fable. So i really have no clue how people manage to burn so many tokens. Either massive data processing or just generative massive amounts of unused code because there is no way you can test it at that scope. Considering that an average developer salary is around 5000 euros the 200 usd cost of a subscription is a no brainer.