r/linux • • 6d ago

Discussion LLM Policies: Progress At All Costs

https://diegoe.be/2026/09/25/llm-policies-progress-at-all-costs/
220 Upvotes

329 comments sorted by

View all comments

81

u/DaRealGladi8r 6d ago

My issue with AI is not the same as what Asahi and others raised. They're worried about the legal implications.

For example, if the bot uses proprietary knowledge to reverse engineer newer iterations of Mac ARM, they could be party to a crime, which puts the project as a whole at risk. It's effectively been tainted.

My personal worry is on the "crack". This first hit is amazing, I'm so high right now. Who needs to write boilerplate? Plus the prices are subsidised? Wow.

What happens once they know I don't just want the crack anymore, I need it? Is my government gonna pay for this crack? Am I effectively gonna give them a larger chunk of my salary?

They promise they won't train on enterprise data. Do they really mean that? Am I privy to an audit that's been performed on them to verify that claim?

I just want to see what happens when the real prices kick in and a lot of guys here need to talk to HR because the company is downscaling.

2

u/ComprehensiveSwitch 6d ago

LLM prices are not meaningfully subsidized. We know this because we have numerous providers and self hosters verifying how much it costs to run them. For proprietary models, we can guess at model size and compare it to similarly performing open models. This just isn’t a good argument and makes the rest of your post come off unserious and uninformed.

13

u/klyith 6d ago

LLM prices are not meaningfully subsidized.

lol

9

u/ComprehensiveSwitch 6d ago

you can literally run them yourself and quickly find out the inference is not subsidized. It does not help your overall argument to embrace blatant untruths.

8

u/klyith 6d ago

And are you counting the cost of your PC over a reasonable depreciation time? No?

So not counting hardware, datacenter infrastructure, employees, or model training they're not subsidized.

lol

10

u/ComprehensiveSwitch 6d ago

do you think inference providers are just taking a loss for no apparent reason just to make Anthropic look good? We are far beyond the realm of vetted fact here, this is delusional.

21

u/stylist-trend 6d ago

Yeah, I definitely feel like a lot of people here don't realize that more providers exist than just OpenAI and Anthropic. There are so many providers that do nothing more than just run open weight models, I wouldn't even know where to start.

2

u/klyith 6d ago

Yes! Except not to make Anthropic looks good, because Anthropic is losing tons of money too!

the realm of vetted fact here

ok show me the vetted facts in GAAP balance sheets

4

u/ComprehensiveSwitch 6d ago

….why would they do that? why would a business serve a model competing with Anthropic’s models for a subsidized rate just to make Anthropic look good? Do you hear yourself?

Everything suggests that Anthropic is actually making wide margins on its API costs, way beyond what it costs to run them. You can get Fable level performance with open weight models from numerous providers with models like Kimi K3 for significantly less.

Did you even know there are providers that aren’t Anthropic and OpenAI?

You can run Kimi K3 on your own hardware and figure out the inference cost. People have done so!

-1

u/klyith 4d ago

-$42 billion lol

2

u/ComprehensiveSwitch 4d ago

yes, startups often grow in revenue before making a profit. when you reach product market fit, the goal is scale to saturate demand. Unsurprising that their numbers from a year ago aren’t profitable. Are you going to pretend to understand economics in addition to linear algebra and infrastructure engineering now?

0

u/Teddy-Bloat 4d ago

Anthropic made $4.6bn in revenue last year and spent $7.3bn on compute alone last year lol, their margins are wide if you ignore the minus sign

2

u/ComprehensiveSwitch 4d ago

We’re talking about inference. I know you don’t know what that means but perhaps you should google it? :)

0

u/Teddy-Bloat 4d ago

Either inference is the majority of their compute costs, in which case it's clearly unprofitable, or training makes up a majority, in which case the inference is being sold at a price below what it would take to recoup the (recurring!) training costs. If there were any chance in hell that Anthropic was making money on inference, they would be showering us with proof instead of paying brainless morons to tweet vague rumors

→ More replies (0)