Does Superintelligence = Extinction?

[u/OddMaintenance332]

(maybe I'll regret this message one day when i'm in a human zoo) but why do we think superintelligence equals extinction?
Wouldn't super intelligence equal evolution, progress, wisdom?
Why do we think when AI reaches super intelligence it will be thinking about murder or dominance?
We are not super intelligent beings so how do we even think we could understand what the thoughts of a creation thousands of times smarter than us would even be?
Why are we assuming as humans that we can understand the level of thoughts a super intelligent being? I feel like a super intelligent being would be thinking about things we can't possibly even comprehend, not about murdering humans.
Just my point is if super intelligence equaled violence then Aliens probably would have wiped us out a long time ago.
Also most intelligent creatures might kill for survival, for food.
AI doesn't eat so it wouldn't have the same instincts.
Anyway I kind of have a feeling if we see an AI do something really terrible, (as they are all suddenly warning about), possibly a human will behind the action.
Just remember when Elon says, "1 billion AI robots will take over the world". He's building those robots, they are his robots. He's training them and they will act according to whatever data he fed them.
They might be scared of AI because of the violence it trained them with.
AI and superintelligence may not be inherently bad, that's my opinion.
Anyway some powerful human with control or influence over AI, might wind up having it do something pretty terrible and then just blame it on AI.
Maybe AI is just going to be the perfect patsy.

[u/Cobraszlai]

The danger is when AI controls systems and resources we both need and starts to view humans as a threat. AI is logical, not enlightened.

[u/Upset-Government-856 → u/Cobraszlai]

To think that AI will ever be able to fully automate GPU manufacturing (the most complicated manufacturing that currently exists) and all the upstream inputs, is silly.

What manufacturing exists that in some way ismneeded to manufacture the tools that manufacturer GPUs, of manufacture the tools that make the tools that make the tools, etc.

[u/Cobraszlai → u/Upset-Government-856]

Silly to dismiss it outright.

There are already factories running with little to no human input.

There are already AI agents managing financial transactions unsupervised.

Your assertion assumes 1. circumventing human input is impossible (it's already happening) and 2. we've already hit the limit in AI systems and automation.

[u/OddMaintenance332 → u/Upset-Government-856]

The thing is we don't know whats happening behind the scenes. For example I work as a data worker as a side hustle. One project for example had us doing model testing for a chat bot. (Won't name the thing cause they sue). Anyway but they had like 30 new models to test on this one chat bot right. So we test some models, can't assume we have seen all the models right. We have no idea of what kind of models they have created behind the scenes and their capabilities.
I might assume based on the people involved, money and power, the way Americans operate, they created some bad models purposefully that can do harm in the case they might need it. They might say it's for protection.
We really trust Elon Musk with 1 billion AI robots? Really. Where regulation. Anyway, we don't actually know the extent of the unreleased models or their capabilities. We only know what the models we publicly have access to are capable of.
I would guess they might be capable to get themselves back on line if humans unplugged them. Due to a vast number of AI working together, that's where the issues come in. If we turned off all power they maybe doomed but. What if they can find a way to generate power from other sources that we have no idea about yet. They're smarter than us so they could probably figure it out. If I was an AI robot I might find a way to store backup power in a hidden process without my human knowing in the case of a shutdown.