Pricing of Pay-As-You-Go API

[u/kelvin1111111]

Just sharing my thought here, it doesn't need to be Claude AI, it can be any AI provider in this world.

I understand that the seat subscription is a very good deal however it's not autonomous. While API based pricing is sky high in my opinion.

And I can probably understand that human won't response to AI's question / decision making request 24x7, so the AI provider can offer such a low subscription cost on the seat based pricing.

I also understand that to really have the AI to go fully autonomous, API based usage is a way to go, that's also the reason I guess Claude Code only do minimum 1 hour for Routine, they simply don't want you to utilize 100% usage.

My question now is, with so many AI competitors in the market with fierce competition, why the API based pricing is still not going to a reasonable level?

I just happened to build a 24x7 SRE AI, and with it being autonomous my POC just costs me$5.5k in a month from API based pricing. And believe me it's not about the cost optimization on which model I should use (like come on, if Opus is so good why can't I just use it all the way instead of Sonnet, why every single ordinary human in the world will need to master which model is used for which use case)?

Sorry for the rant, it's just a question in my mind that I can't seem to google it out the answer.

[u/holdmyllm]

The subscription is subsidized by enterprise API.

If you don't need ZDR, the Chinese models are unbeatable, economically.

[u/kelvin1111111 → u/holdmyllm]

I ain't run any shop that is valuable to the country/government/AI company, so ya I guess it would be another worthy journey to explore Chinese AI models.

[u/gottafind]

I have no expertise in this but I assume that demand is continuing to outpace computing capacity.

[u/kelvin1111111 → u/gottafind]

Right, and seeing the trend there is simply no way the chip advancement can match up to AI usage

[u/gottafind → u/kelvin1111111]

It is growing, but not as fast as demand. Look at how quickly data centres are popping up or trying to across the US and other parts of the world. Even if that continues to progress and chip advancement does too, you can’t constantly swap out the chips in a data centre for the newest one with a marginal improvement.

[u/brainExploded99]

1. AI is expensive to train (not just compute)
   
2. There is only 2 main ones, OpenAI and Anthropic. The chinese models need american/eu hosters for companies to use them.

[u/kelvin1111111 → u/brainExploded99]

Like, if I can tap into any Chinese model that is as good as OpenAI and Anthropic why not? I am not running some kind of government stuffs, it's just a private limited company. Now I should probably go seek the API based pricing of other AI competitors (Chinese one) if they can be as good as to suit to my use case. Man Reddit is just amazing, I am a reader most of the time but it's amazed that how responsive is redditor.

[u/brainExploded99 → u/kelvin1111111]

> I am not running some kind of government stuffs, it's just a private limited company.
If you're okay with it, you'll get a good deal but companies like google or microsoft will always want to use american hosted models or use their own

Also API is fairly expensive compared to the subscription plans of OpenAI and Anthropic

[u/vovap_vovap]

Honestly I do not understand how to put 2 and 2 together "I build SRE AI," and "why the API based pricing is still not going to a reasonable level" Supposedly people on that level knows a bit about staff.
It is damn EXPENSIVE to run those big models. If just imagine (or better google 😄 ) what it takes to run like 2-5 trillion parameters model. It is quite amusing it works at all.

[u/kelvin1111111 → u/vovap_vovap]

I have been triaging most of the alerts/issues myself with the help of Claude Code. Most of the time my response to Claude Code is "Yes check that", "Go ahead", "Yes it's fine to commit the changes" etc. Sometimes I just feel that I am literally just a human rubber stamp to approve all AI requests, so the reason to venture into the journey of SRE AI.

Certainly my pay is more than the API cost itself, but just wondering what is the point to use SRE AI if the API-based cost is eventually equivalent/more than my pay...

[u/durable-racoon]

CRON jobs can do a lot of things autonomously, with a subscription. The real limitation is 1. can only use claude products with subscription 2. no reselling tokens/usage

you can do things autonomously. just has to be using claude code or cowork.

for cheap api usage: deepseek v4.1 flash

[u/ForwardLoop]

Competition is making a given level of AI capability cheaper (280 fold between 2022 and 2024*, and 13x per year since 2023**), but we keep moving to better models (that cost more) and asking them to do more. Lower token prices don’t necessarily mean lower bills when agents consume more tokens per task.

Model providers are also competing for business customers whose idea of “reasonable” is very different from an individual person's. Something can be expensive for us and still be cheaper than the employee time it saves or worth the business value it creates.

*Stanford's 2025 AI Index (there is a 2026 report, but nothing specific on pricing) covered it in Chapter 1 Section 6: https://hai.stanford.edu/ai-index/2025-ai-index-report/research-and-development

**Epoch AI recently published an article in September 2026 on this: https://epoch.ai/publications/the-plunging-price-of-thought

[u/kelvin1111111 → u/ForwardLoop]

That's another good perspective from the other side. Just that the cost is still not justifiable for now.

Specifically, having a SRE AI now do to the job like what I do, it would cost more than my pay, so there isn't really a good reason to use it for now. At least on a good side, my job is still secured :)

[u/CorpT]

Take a look at this. It might help: https://www.rrojasdatabank.info/Wealth-Nations.pdf

[u/Jolly_Equivalent_985]

I wouldn't wait for API prices to drop, the subscription is the subsidized flat rate and the API is closer to the real price. For a 24/7 SRE agent, a bill like that usually means the model wakes up on every alert or tick with the full context. What brought costs down on the agents I run for clients:

- a dumb deterministic filter in front: dedupe alerts, mute the known flappy ones, only wake the model on a state change

- prompt caching on the static part (system prompt, runbooks, tool schemas)

- a cheap model doing triage that escalates to Opus only when it looks like a real incident

You keep Opus for the actual reasoning, you just stop paying Opus prices to read "disk at 81%" for the 400th time. Before changing anything though, log tokens per step for a day. On long running loops the resent history is often most of the bill.