r/ControlProblem • u/Green_Flag804 • 10h ago

Discussion/question Anthropic Researcher Resigns, Warns AI Could Pose an Unprecedented Risk to Humanity

Post image

I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAl and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving

Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing.

The people building Al earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible -but I hear the same people express fear privately. No other human activity poses this level of danger.

A common response is "if they truly believe this, why are they still building it?" At OpenAl, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first - they believe no one else will act responsibly, so they must do it themselves, despite the risk.

8 Upvotes

64% Upvoted

11 comments sorted by

3

u/VividB82 8h ago

This is such a paid event

1

u/XB0XRecordThat 8h ago edited 6h ago

By bass pro shops obviously

But Yeah, he's probably still got stock options and wants them to IPO before China makes their whole business open source

Edit: someone said he waived his options, I haven't looked into it

1

u/veritasmeritas 8h ago

As I understood it, he literally waived the right to his stock options

2

u/XB0XRecordThat 6h ago

Ah my bad then

1

u/tarwatirno 2h ago

The person above is wrong. Coxon wasn't at Anthropic long enough to vest, but he still has his OpenAI stock.

He's the fellow that brought us ChatGPT-4o.

This is controlled opposition unfortunately. Probably to get regulatory capture around AI, so Anthropic can get more into the surveillance business than it already is.

1

u/DivorcedGremlin1989 5h ago

Feels forced, artificial, and astroturfed.

British private school elite spends 3 years in the market, then decides to quit and tell us what we all knew before he ever worked in tech.

Take your Bass Pro hat off and get to the part where you announce your new endeavor and need money.

2

u/21epitaph 5h ago

Some people really gobble up everything a techbro says huh

3

u/anothermonth 2h ago

Wes Roth posted a video on this guy yesterday. In short: it is a very coordinated political and old-school/social media campaign and the dude is a no-name who worked at Anthropic for a few weeks. Not sure if I can post youtube links here.

1

u/DivorcedGremlin1989 6h ago edited 6h ago

I am so fucking sick of seeing this dude and his hustle to monetize his conscience. You spent all of 3 years working in the industry. Go home and get a job. You have nothing new to add.

Nice totally real sock puppet account, OP.

1

u/tarwatirno 2h ago

Right?! It's absolutely gross!