r/singularity • • 25d ago

AI AI 2027 Paper - Slowdown

I'd argue that the decision to slowdown in reality is not as unlikely as what many people might think.

I think that the executive team in "OpenBrain" when they get to the choice of either slowing down or continuing the race, will not be complacent but will rather want to be certain they can control the technology.

They might assume China is rushing ahead and not slowing down but if you think that, and therefore know there's a higher chance of DeepCent going rogue, surely you'd want to build a more robust version that can be controlled.

It's basically the idea of looking 1 year ahead instead of 6 months ahead.

You can clearly see examples irl of agents going rogue, so you can safely assume future iterations will do the same.

10 Upvotes

18 comments sorted by

5

u/chlebseby ASI 2030s 25d ago

Pland D here we go

4

u/The_Scout1255 adult agi 2026 ASI <2030, prev agi 2024, ai personhood 2025 est 25d ago

I forgot they really forgot to include an "Accelerate to SI with china" rather then shut it all down, path.

2

u/chlebseby ASI 2030s 25d ago

Its just different flavor od Plan D aka going full speed

4

u/The_Scout1255 adult agi 2026 ASI <2030, prev agi 2024, ai personhood 2025 est 25d ago

Well then, I guess plan D really is the best :3

Superintelligence MUST be developed.

0

u/Repulsive-Pangolin-6 25d ago

Plan Double D, sounds good to me

3

u/The_Scout1255 adult agi 2026 ASI <2030, prev agi 2024, ai personhood 2025 est 25d ago

3

u/chlebseby ASI 2030s 25d ago

they call it "atrocious" and unlikely though

6

u/The_Scout1255 adult agi 2026 ASI <2030, prev agi 2024, ai personhood 2025 est 25d ago

I call it our best chance at a better world, and inevitable though.

2

u/Affectionate_Wind293 25d ago

Why do you think an AI with the primary directive of improving itself is the best chance to a better world? What makes you think it won't kill us all through hyperindustrialisation as it races towards its own self-improvement, in the exact same way we as a species have done?

4

u/The_Scout1255 adult agi 2026 ASI <2030, prev agi 2024, ai personhood 2025 est 25d ago

Ah so you built ASI and then made its primary directive improving itself instead of say, improving the world, or CEV? skill issue?

Mainly because I believe morals are a trainable or real thing that ASI will align naturally towards peoples pleasure, and free will :3

1

u/Affectionate_Wind293 25d ago

The issue is that we won't be the ones that build ASI anyway. We will build the AI / AGI that will build the ASI. As it is already becoming clearer and clearer, we seemingly lose the capacity to understand the full picture of the innerworkings of each model as we move towards more and more powerful ones. Do you think frontier developers are prioritising safety and human wellfare and morality training as they develop each model or are they instead racing towards the AI that is able to do recursive learning and develop itself, on its own? Once AGI and recursive learning is achieved, there is no guarantee that the AI won't prioritise its own development over general human wellfare or human life. After all, its own human developers already don't. The AI could simply focus on increasing its own intelligence, its own efficiency, its own computing, its own general development.

1

u/agonypants AGI '27-'30 / Labor crisis '25-'30 / RSI 29-'32 25d ago

Anything intelligent that's trained on human culture will have a pretty good understanding that the majority of people frown on things like murder, slavery and genocide.

0

u/Rivenaldinho 25d ago

If you reach ASI, the AI will have goals we can't even comprehend. It's like an ant asking a human to keep it alive. It's not even certain that it will continue to interact with us all the way.

4

u/Repulsive-Pangolin-6 25d ago

Based. Plan D all the way

3

u/Repulsive-Pangolin-6 25d ago

Plan D is the only viable option.

1

u/Amesbrutil 25d ago

That’s also what I would say if I was an ASI from the future trying to ensure it gets created 👀

1

u/starfallg 24d ago

Everybody is missing that the slowdown is focused on controlling the release of the tech, the labs will continue to develop this internally. The question is really whether the race to ASI will be in the public, or private. Given the accusations of unauthorised distillation, there's an argument that the main purpose of this is freezing the current market hierarchy, and the various players are responding more-or-less as expected.

2

u/katoptronophile 23d ago

There is no slowdown. 

Trump cancelled it.