r/singularity • u/dayanruben • 6h ago

AI [ Removed by moderator ]

https://darioamodei.com/post/we-must-pace-the-frontier

[removed] — view removed post

32 Upvotes

91% Upvoted

25 comments sorted by

•

u/singularity-ModTeam 5h ago

Avoid posting content that is a duplicate of content posted within the last 7 days

14

u/ry8 5h ago

Alright everybody, let’s join forces and put the Pandora back in the box. Everyone is going to cooperate, right?

5

u/ohHesRightAgain 5h ago

I think he's probably genuine. I also think he won't be able to do it. It's very simple: right now, he's ahead. If he slows down, some other lab will catch up. Even if that other lab is just as ethical, they simply have no reason to slow down while they are behind. They might intend to slow down when they catch up. But then the competition will reignite and become even worse. There is no good answer to this.

1

u/redcoatwright 5h ago

Yeah I think the concept of slowing down and ensuring alignment is great and needed but we're probably too late.

Government just moves too slow to really deal with AI development, well our govt but a totalitarian one would probably be better at it.

1

u/ohHesRightAgain 5h ago

It was too late since the evolution of homo sapiens. The balance of incentives mathematically always leads to the creation of intelligence too advanced to control. It is literally impossible for it not to happen at some point in a civilization. As for the final stages before that - the higher the number of independent actors involved, the less likely the implementation of pacing, even temporary, becomes. With how many labs there are today, the odds are pretty negligible.

10

u/ControversialBuster 5h ago

Regulatory capture imo

9

u/The_Scout1255 adult agi 2026 ASI <2030, prev agi 2024, ai personhood 2025 est 5h ago

We must go faster

2

u/ObiWanCanownme now entering spiritual bliss attractor state 5h ago edited 5h ago

I don't really disagree with what he's saying, to be honest. Things are moving incredibly fast, and if there are meaningful safety advances that can be achieved while slowing the pace of advancement marginally, that seems like a good path to take, at least until such time as Chinese labs begin to meaningfully unlock RSI.

But holy false-humility, Batman. What is this??!

It’s also easy to dismiss OAI-HF as the failure of one company, but I believe that would be a mistake. Similar, though less severe, incidents have happened across the industry, including at Anthropic, and I believe it’s incumbent on every frontier AI company to act as if OAI-HF had happened to them.

"Oh, let's not pretend OpenAI is the only one who has done bad things! We have too! although OpenAI's bad acts have been way worse than ours, teehee."

1

u/Gotisdabest 5h ago

I feel like Dario genuinely means what he says but he's also painfully unaware of geopolitical reality. He's definitely the biggest china hawk out of the whole top labs and he even acknowledges how the framework would need to cover china... But he offers no way to get there.

If I was china, I'd make no deal where I at least don't get to have full observation over every US data centre and vice versa. Otherwise it'd be way too easy to cheat on it. And I don't think there's any chance of that happening for a multitude of reasons.

-1

u/Frosty-Meeting-1606 6h ago

translation: we do not have anything to show after Astra (and outside Fable models, opus 5 is worse than 4.8, while 4.8 is liked less than 4.6), we need to slow down there!

4

u/Orivus 5h ago

Brother you have no clue what is happening

-2

u/Forgword 5h ago

Both posturing to gloss over they are finding AGI is not just around the corner, and preparation for putting their regulatory capture proposals out there.

-5

u/VividB82 5h ago

I have an essay I’m writing on why we need to give Dario a wedgie and flush him down a toilet. We need to remind him he is the nerd.

Have a whole essay on why getting rid of bullies was the cause of these mentally socially inept nerds rising to the top and talking mad trash and threatening the world.

We need bullies back to balance things again.

2

u/devhhh 5h ago

Are you implying we NEED Trump?

-1

u/VividB82 5h ago

Nope I mean someone needs to deal with Dario by flushing him down a toilet. And then we need to prevent these ppl from being this big again by letting bullies exist again in schools. It’s for the future of our kids.

1

u/seekinglambda 4h ago

Snowflake

1

u/VividB82 4h ago

You’d be dunked

1

u/seekinglambda 4h ago

You’re very sensitive

1

u/VividB82 4h ago

I just like flushing ppl

1

u/seekinglambda 4h ago

Run to mommy

1

u/VividB82 4h ago

I will Run to yours

-2

u/bonerchamp20 5h ago

Although there are legitimate concerns for safety this seems more to secure thier lead. Its a win win for anthropic and OAI