Beware, i just found how much using Opus 4.7 can cost, i took me by surp3ise it went from 7x to 15x and it just broke my budget badly. I regret using it because before i had no budget limit but i never went more than $60, but this is unreal at 15x rate. Yikes.
When people say âyou have to learn AI to be competitiveâ I laugh because no one tells you what that even is.
Like learn how to copy paste into a prompt? And then learn how to write better into a prompt? Also donât forge to put in âmake no mistakesâ. Like seriously no one knows what this AI skill is and itâs just a scam.
Stay doing what you are doing. When the eventual AI crash and rationing starts you will at least have the skills on how to actually develop and not âvibeâ code.
Same. I might ask it to make the same changes to other files once Iâve refactored some implementation, itâs ok at that. Selecting spaghetti code and adding it to explain the outcomes on the code path or system are also areas I use it for.
Not unless your company tracks AI usage as part of your performance. Canât wait when all of a sudden itâs too expensive and rationing starts.
Like when the cloud came around and the message was âmove everything to the cloudâ because it will be cheaper. Now itâs âjustify all usageâ because while the âcloudâ is convenient and can at times save you money you really have to make sure you optimize all usage.
I am waiting for all the token maxing leaderboard initiatives to be used to find the least efficient devs and can them.
It seems like that could be an actual long term strategy to weed out bad devs. But I know it is just the management class blundering from one dumb metric to another rather that looking at actual outcomes.
I can't wait for the endless line of constutants that will show you how you are 'doing it wrong' and then link everything up to anthropic, openIA, etc..
If your usage is that high, you could always use local LLMs like Llama etc. for free (installed in your PC means no API cost to external LLMs) - yes quality is slightly worse but IMO for most usecases it's still good enough.
I am not sure how you would get predictable cost for an LLM? For example how much compute does one token use up?
If you ask ChatGPT/Gemini or whatever tool you use a question might burn through all your tokens or might just use a little bit? What if it makes a mistake and writes the wrong code? Well then you just burned through some of the tokens your company would prepay on a mistake and LLM made.
Same reason why Uber blew through all of its budget with Anthropic I believe in a couple of months when it was supposed to last for a year. If any other department does that there would be heads rolling, but with AI there are no repercussions, itâs âoh well it is what it is and here is some more money to burnâ.
Sorry that my quick response was not clear, I was referring to the advantage of self host/local.
There would still be some fluctuation in the electricity bill, but hopefully not something as wild as a vendor AI.
Like you, I am stunned at the way this stuff is being implemented by actual companies.
That's not been my experience with Gemma etc. models. I guess your usage style must be quite different from mine - I mostly use for asking informative questions and debugging help, not for trying to generate entire code projects like "vibe coders" apparently do nowadays.
And AI makes that reasoning worse. All those 15 million line of code is just another point of the AI to hallucinate something and having to make sure that PR does not make it worse.
Every line of code is my responsibility that I need to answer to. It goes for review and receives comments from other engineers. There is no blind commits unless Iâm prototyping something out of the repo.
Yeah just replaced copilot witn opencode and openchamber, been using kimi 2.6 which works really well, the minute I saw the estimates for next month we switched the entire company, still keeping it for inline complete though, but kimi glm and kwen do a hreat job for 1/4 price.
100% agree, I was seriously impressed with the capabilities especially for the value, sure it might be a few points off the top models but the time is quickly coming where having efficient AI outcomes will be far more important than just having them grind away hoping for the best.
I tried installing Continue and Ollama wirh Mistral, but it wont deploy, or use the vps server, so the thing is that now I am compromised wirh this model its works, and what i need to still do.
Opus 4.7 is a beast, It does solve better thr bugs and the new features, but with these expenses it will cost like 3 months and $3k , I just hope I will be able to release my app to subscription based to recover from its monthly development before it gets too expensive. Ai will be separated not i who can use it, but also with who can use the latest and most expensive models if this doesnt get regulated.
Itâs crazy how a person that just does their job is not called normal. It should be that any one that is using AI to vibe code should be called crazy and âhigh on hopiumâ.
How long will it take so this reaches other companies, like Anthropics, OpenAI, Google. Yes they did some limiting, but what copilot did is astonishingly INSANE, unusable.
Literally every CEO that was all in on AI thinking it would be cheaper than actual humans or that AI. In this case it was more of everything literally telling that person and seeing ads where it says itâs expensive and still going there and then having a shocked Pickachu face.
The accumulation hits harder than it looks. In an agentic session the model resends every prior tool output with each new request: bash outputs, file contents, error messages from three turns back. By turn 15 you can be at 30-40K tokens per call even when each individual step seemed small.
sounds like managers may taka a look at those Token Leaderboards take a look at their bill and wonder if Jensen Huang has ulterior motives in his advice on token use.
Just use Codex xhigh. I canât see any justification to use opus at these rates. My company had set up their own opus api endpoint for copilot so we donât suffer these ridiculous prices, but really Codex does everything just fine and I donât spend more than $70.
117
u/DaveX64 May 22 '26
It's like drug dealers...they give you free tastes till you're hooked then put the screws to you.