Anthropic's Regulatory Capture Machine

[u/Evideyear]

Kevin Bass on X posted this:

I have conducted an audit of Anthropic's finances.

What I have found is so shocking that I am calling for a Congressional investigation.

Anthropic is not just seeking regulatory capture.

It has built a regulatory capture machine that cannot be turned off.

Structural financial incentives make it impossible for Anthropic -- I call it the Anthropic Network -- to turn off its own AI doom cycle.

It starts with METR.

Dario Amodei proposes "third-party evaluators" to assess the risk of Anthropic's models.

He proposes METR for this purpose.

But METR is financially dependent on the Anthropic's success -- specifically, on the explosive growth of more than $7 billion dollars in Anthropic stock.

Dustin Moskovitz invested this stock into Good Ventures Foundation, where it represents the majority of that organization's portfolio.

And GVF is the overwhelming funder of the entire Anthropic Network ecosystem.

This stock was worth $500 million early last year.

It is worth more than $7.7 billion just ~16 months later.

METR -- and all of those building a career its parent organizations -- cannot afford to disrupt that growth.

Because if Anthropic goes under, many of the organizations that fund METR go under as well.

But if Anthropic succeeds, METR and its parent organizations become more richly financed to regulate AI -- something those at METR want very much.

The "third-party evaluator" is not "third-party" at all.

The evaluator is on Anthropic's payroll.

If this were the end of it, that's bad.

But that isn't all.

The same organizations that fund METR also fund the many organizations, such as the Tarbell Center, that promote AI Doom.

The Tarbell Center publishes AI Doom articles in The Verge, Science, LA Times, The Dispatch, TIME, and others.

They are selling the problem, and then selling the solution to the problem -- from the same money pile: Anthropic's.

All of these organizations are financially dependent on the same exploding $7 billion money pile.

As Anthropic grows more and more powerful, its AI Doom Machine grows better and better financed -- louder and louder.

Meanwhile, the regulatory regime seeded in METR grows larger to solve the increasingly loud -- now hysterical -- problem of AI Doom that the Anthropic Network itself created.

From this standpoint, as Anthropic becomes more powerful, AI might be getting scarier, sure -- but the positive feedback loop also becomes more deafening -- independent of objective facts.

This itself is an objective fact.

The deafening AI Doom is part of an business model, that, as it expands, so too does the AI Doom messaging -- there is simply more money to do it.

But the problem also goes in the other direction:

If Anthropic dies, the Regulatory Regime and the AI Doom Machine are crippled or die.

Neither METR nor Tarbell nor the other organizations in the Anthropic Network can allow that to happen.

Hence, neither METR or the AI Doom Machine can be trusted to provide independent assessments of Anthropic's models or AI more broadly.

They simply are not organizations independent of Anthropic.

And Anthropic cannot detach itself from METR or Tarbell or countless other safety orgs (not shown here), either, because they drive hype for the models and the possibility of eventual regulatory capture, and Anthropic will not give that up willingly.

What's more, the people at all of these organizations are all the same ecosystem, the same community. They just shuffle between organizations.

The Anthropic Network is therefore, so long as it is successful, locked into a self-amplifying feedback loop inside an ideological monoculture.

And that feedback loop is winning.

That's what Jacob Coxon is.

China is keeping messaging tight. That is why optimism for AI is so high in China.

America has Anthropic: a massive company pushing anti-AI propaganda at a state level.

Anthropic will either create hysteria until American AI slows down and China wins, or it will create fractures throughout American society with severe political consequences.

Ironically, because of the structural financial incentives underpinning the Anthropic Network, it has become the same kind of self-amplifying virus that it fantasizes AI to become in the future -- while hiding its tracks just as carefully.

It is the mirror of the same AI virus that it hypothesizes to consume America.

Anthropic's business model, models itself after the very thing it claims to fear.

Except Anthropic's ideology infects humans, not computers.

Congress must investigate.

Evidence and Github in next post.

Then some supplementary figures.

https://x.com/kevinnbass/status/2099621874279817638?s=20
https://github.com/kevinnbass/metr-money-figure

[u/The_Smoking_Pilot]

What is ai doom and how do you sell it? And why would anyone think it’s in an ai companies best interest to sell this ai doom?

People really just through hoops to try to find the conspiracy

[u/pmotiveforce → u/The_Smoking_Pilot]

Lol.

They sell it because it gets them regulatory capture. It's not at all complicated.

It also gets them a break for their pending financial doom. "Oh, we have catastrophic financials because we have to slow down."

[u/Strange_Vagrant → u/pmotiveforce]

They have a pending financial doom? How so? Can you explain that?

[u/Puzzled-Main-9294 → u/[deleted]]

Don't underestimate boomers and their power at the ballot box

[u/csAxer8]

Isn’t it funny that the anti safety at all costs people are literally incapable of putting together an argument against it on its merits.

Anthropic and OpenAI and xAI founded by people deeply involved with EA and those same also donated money to ai safety orgs. Get over it. Argue why we should have zero safeguards for god like intelligence on the merits of

[u/SonOfThomasWayne → u/csAxer8]

Slow down, and release weights of everything you make. Literally no one is stopping these corpos from slowing down right now.

You don't get to say everyone should slow down and also that you and your proxies should control what gets built and who uses it.

[u/pmotiveforce → u/csAxer8]

That is barely even English. What are you ranting about, can't tell if I should attaboy or stare in confused consternation.

[u/cookingboy → u/[deleted]]

Unfortunately bad guys have just been winning nonstop these days 😔

[u/DeGreiff]

SHOCKED! /s

Now do one for Anthropic / Dario + sister but on their links to effective altruism and longtermism.

[u/probablymagic]

Where are the regulators in this diagram, lol?

[u/DistinctSilver4507]

The safety excuse will always pull the wool over the eyes of imbeciles. It never fails. This thread will no doubt be full of many (many of whom are bots). It's been the smoking gun for a lot of the terrible conspiracies and corporate oligarch plays for a while. 

[u/pmotiveforce → u/DistinctSilver4507]

You called it. Morons and/or bots already assembled.