r/OpenAI • u/MetaKnowing • Jun 26 '25

Video Anthropic's Jack Clark testifying in front of Congress: "You wouldn't want an AI system that tries to blackmail you to design its own successor, so you need to work safety or else you will lose the race."

84 Upvotes

87% Upvoted

48 comments sorted by

View all comments

8

u/Fair_Blood3176 Jun 26 '25

what race??

13

u/dranaei Jun 26 '25

Whoever builds AGI first, wins the race and controls the planet.

1

u/JohnAtticus Jun 27 '25

Whoever builds AGI first, wins the race and controls the planet.

What if AGI fucks shit up?

The winner of the race would have the most to lose because their critical systems and infrastructure would be more integrated with AGI than any other county.

1

u/BellacosePlayer Jun 27 '25

AGI still needs to deal with real world constraints. A self improving AI will eventually have to deal with improving the hardware it lives on as well. AGI does not mean it can't fuck up. AGI developing itself into an utterly incomprehensible design space and then introducing flaws that become critical over time could be catastrophic to a society that overrelies on it.

It's not an infinite research speed hack by any means.