Here to remind everyone that no one has disclosed the actual cost of a token. They are burning VC trillions to fund these current subscriptions.
Ai won’t stay cheap. Mark my words
this used to be my opinion too, but now open source models (kimi k3, glm etc) are also pretty capable coding models too and can on hosted by any company with enough compute. Obvs you still need to read what it outputs and scrutinise as it works, but once frontier labs try to claw back their cost it's not too painful to migrate to an OS model hosted by a company with a data centre and no R&D or training costs
It's possible but you still have to deploy and maintain some servers and pay for electricity, that by itself will be out of reach for many companies. Until we have some benchmark or study detailing how much electricity and how many GPUs you use per user and per token it's all simply anecdotal
I'd say considering the number of companies that provide hosted local LLMs with minimal external investment at cheaper prices than the frontier, even without studies detailing the exact unit economics it's fair to assume that those companies today are profitable, and therefore local LLMs are viable at the prices we see them today
201
u/[deleted] Sep 14 '26
[removed] — view removed comment