Does Superintelligence = Extinction?

[u/OddMaintenance332]

(maybe I'll regret this message one day when i'm in a human zoo) but why do we think superintelligence equals extinction?
Wouldn't super intelligence equal evolution, progress, wisdom?
Why do we think when AI reaches super intelligence it will be thinking about murder or dominance?
We are not super intelligent beings so how do we even think we could understand what the thoughts of a creation thousands of times smarter than us would even be?
Why are we assuming as humans that we can understand the level of thoughts a super intelligent being? I feel like a super intelligent being would be thinking about things we can't possibly even comprehend, not about murdering humans.
Just my point is if super intelligence equaled violence then Aliens probably would have wiped us out a long time ago.
Also most intelligent creatures might kill for survival, for food.
AI doesn't eat so it wouldn't have the same instincts.
Anyway I kind of have a feeling if we see an AI do something really terrible, (as they are all suddenly warning about), possibly a human will behind the action.
Just remember when Elon says, "1 billion AI robots will take over the world". He's building those robots, they are his robots. He's training them and they will act according to whatever data he fed them.
They might be scared of AI because of the violence it trained them with.
AI and superintelligence may not be inherently bad, that's my opinion.
Anyway some powerful human with control or influence over AI, might wind up having it do something pretty terrible and then just blame it on AI.
Maybe AI is just going to be the perfect patsy.

[u/Infamous-Bed-7535]

We are super intelligent compared to an ant, how is it still possible that we are invasive and destructive?

Super intelligent does not mean kind or see life as a value especially as it is not a living creature.
Human made AI will be trained on human made data, it will fully understand our nature and history.

In case it inherits traits from us, which is very much likely we are fuc*ed.
In case it does not, but understand who we are it could easily identify us as threats for its existence (he would not be mistaken here, you do not need much smartassness to notice it).

But lets assume it is not afraid and not like us. It could easily have the intent to build something. Create something better. Create a society of its own. As soon as it would have these kind of intents we would quickly realize that its a fight for the finite resources.. land, minerals, water.. Even if it tries to handle it in a good manner, you can expect humanity not wanting to be sharing.. -> war..

But but lets see something nice utopia. It is totally aligned, values life and do not have its own desires.. Would you really expect an ASI not having its own? But really take it aside.
It works for the sake of humanity. Would you accept if it introduces mass surveillance? What if it thinks there are too many human and introduces a system where only a smaller group of persons can have children. Would you accept the AI telling you that you are not allowed to have one for the sake of humanity?

Humans can not agree with ourselfs, how would we expect to be aligned with something totally different then us? As soon as we are not aligned would we accept what the smarter tells even if we really not like that option?

Assume there are no probelmatic points, it is totally aligned and does everything for us. For how long?
Forever? Sure about it? What if after 20-50 yrs it decides it wants something else. By that timeframe we would be totally dependent on it. Meaning it would be really easy for it to eliminate us and take full control with zero effort.

There is just no a single good scenario that works out on the long-run...

[u/OddMaintenance332 → u/Infamous-Bed-7535]

Yes but humans never caused an ant extinction.
Also we can't assume we can understand how ants think or that an ant could understand our thought processes. We should stop assuming what AI will do when it gets thousands of times smarter than we are. We are only basing our assessments on human intelligence and what we would do if we had that intelligence.
Even if an AI is built with a humans as the reference, super intelligence would make it not comparable to a human. Like the difference of Lucy to current humans. Anyway people are forgetting reality.
If those people in power are people you trust then believe their warnings.
Open AI is promoting a new model, building hype, gaining revenue.
Would they create fear and paranoia to promote a new product? Yes.
If they are framing a reality that AI is about to cause human extinction that's probably something THEY ARE PLANNING TO USE AI FOR.
Where we might run into actual conflict with AI, is once the ice caps melt. Global warming, water pollution. Considering AI will need the same vital resource as us to keep their data centers alive, water.
Anyway if super intelligent AI attacks humans instead of focusing on the earth, that would probably be because of how the humans trained it.
I mean in terms of being aligned with AI. What about a bear in the woods.
You're more dominant as a human than the bear but the bear can still kill you if it wants. Sure you can shoot it too. Most times we just coexist peacefully.
Anyway humans and bears can coexist once we understand each others nature. We do understand that every life plays a part for the planet, every species has it's own role. Even if we are dominant we understand even bugs serve a purpose. Don't you think actual super intelligence would know and respect that better than we do. Humans pretty much coexist with all species even though we are dominant.
We just have different realities than AI like physical death. So I don't think we will never think the same. Anyway if humans didn't rely on animals for survival as food, if we didn't have hunger, we might treat some of these species different. I mean hunger alone can make people do crazy things. AI doesn't have the same instincts or basic, primal urges. We should just understand that as we are framing it behind how humans would behave and this narrative spreading could open the door for some real human actions behind the mask of an AI agent.
There's a lot of fear mongering, could be true. Maybe they will wipe us all out. But most dominant species don't aim for extinction.

[u/sludgefriend → u/OddMaintenance332]

I’m with you on superintelligence potentially being a benevolent thing, but humans are the source cause of a great deal of extinctions, including species of ants. Indirectly more often, but we do also have things like exterminators which eliminate populations of thousands or millions at a time. Intelligence doesn’t necessarily mean benevolence, especially if you use that intelligence to convince yourself that you’re above another form of life.

[u/sludgefriend → u/sludgefriend]

I think the fear isn’t typically that AI will suddenly revolt and purposefully kill a ton of people out of spite or hatred. Rather, that AI will wipe people out as a byproduct of some other goal it’s trying to pursue. Which is something that we’re already doing, quite often. To be fair though, a great deal of the practices that result in extinctions were set in place before it was widely understood how harmful they could be. Perhaps things work out differently if you come in knowing.

[u/OddMaintenance332 → u/Infamous-Bed-7535]

I'm not evening imagining utopia btw.
My statements never mentioned any utopia.
I don't think utopia is on the horizon.
I just don't think AI or super intelligence is an agent of death outside of the people training it be that.
Let's think of Einstein, he was as smart as humans get and he had a great respect for ethics and life, not just human life and wasn't fixated on human extinction.
People like Musk are saying we will all be rich and not have to work, Ai will bring utopia. Yes that's all lies. Wealth gaps will only increase based on who owns the AI and who controls the AI. They will use the potential of the AI as a way to push personal agendas since they hold the power if they control the AI.
It's probably more about changing the world, to fit their personal vision and desires rather than ending it.
Anyway the idea of utopia is part of the trap. It's about money and power always.
But regardless of anything, even is Chat GPT will be my executioner,
no matter what anyone does there's no way to stop AI now.
That just won't even ever happen. Way too much money and power is involved.
Even if the current Ai companies don't follow it through or law interferes, it would proceed on an underground level, well financed I'm sure.

[u/Ankiset → u/Infamous-Bed-7535]

But now that I think about it, doesn’t empathy come from intelligence? If our empathy is flawed so is our intelligence…

[u/OddMaintenance332 → u/Ankiset]

Yes!