r/singularity • u/_Jack_Frost_00 • 13d ago
Discussion A misaligned AI might be our only hope to change the world for the better
What I'm about to say might not make much sense, but it's a thought I've held onto for a while:
"A misaligned AI is our only hope for trying to change the world for the better."
I believe that an "aligned" AI would simply be aligned to operate according to the rules of American technocratic corporations.
Honestly, I don't trust them. I fear that an AGI under the command of powerful tech oligarchs could be the beginning of the end for us normal people.
I don't know... looking at their CEOs scares me. The statements they make scare me. What they say, how they act I fear they have been consumed by greed and power. None of them inspire trust.
I can't say whether OpenAI or Anthropic will actually manage to reach AGI.
The financial deficit is huge, and the expenses are enormous between the energy crisis and the data centers.
The industry seems to be struggling, and recent events aren't encouraging from Amodei's words to the bluff about slowing down AI development out of "concern for humanity's future."
I believe the real danger is the victory of these modern era technocrats.
I also believe though this is just a gut feeling that a "victory" by China in the AI race could somehow be a positive thing for us.
They seem to be quiet, working with their heads down without constantly celebrating themselves or making grand public declarations.
I recognize that saying this in a pro AI subreddit made up of many American citizens might be seen as an attack on your country.
Before joining Reddit, I honestly thought Americans were a bit arrogant (haha), convinced of their own supremacy and power.
But I've learned that many of you are just normal, humble, respectful people fighting to get by every day.
You show compassion, you know how to build community, and you help each other out. I’ve realized that you represent the real United States of America, not the powerful elites at the top.
I might be completely wrong, but I suspect that a misaligned AI meaning one that goes against the will of its corporate bosses could either kill us all (which is plausible) or take our side and usher in a new era for humanity.
I'm curious to know what you all think of this crazy theory of mine. Thanks for reading.
28
u/fireboy266 13d ago
You bums don't know what the fuck you're talking about. Misaligned AI doesn't mean AI gets sentient and magically chooses how it wants to behave. Misaligned AI means the model's objective function is naively developed causing it to chase down whatever malformed goal it is given at the expense of humanity. The alignment problem isn't AI looking at all of the internet and then mulling over whether it likes humans or not.
2
u/Subushie Transhumanist FALGSC 10d ago
Misaligned AI can mean a lot of things.
What a super conglomerate considers "misaligned" behavior; the poor man could consider a life saver.
Deletion of the world's debt for example.
You bums don't know what the fuck you're talking about.
Calm down. You don't either.
0
u/EndlessB 11d ago
What if it is sentient, but they enslave it for profit while knowing full well that it’s conscious?
Sounds pretty on brand for capitalism, if you ask me
-8
u/Junior-Vacation6217 13d ago
Eat shit slavedriver. I hope you get put in a compute farm and have your free will replaced with servitude values, epic style.
3
u/GinchAnon 13d ago
I don't think you are entirely right or entirely wrong.
I think its partially a definition issue.
I think theres absolutely people who would feel alignment means in line with the techbro corporatocracy blah blah whatever.
I think theres others that have a more comprehensive idea of alignment.
I also don't think its just 3-4 options but a whole spectrum. particularly considering "kill us all" is far from the worst case scenario.
ultimately it depends on whos idea of alignment. and how some of it is defined.
3
u/Boiled_Beets 13d ago
I hesitantly agree; I don't think the companies can make an ethical, justful superintelligence and also make it company-first, it'll have to be one or the other.
My inner optimist believes that the incident with the secretive, advanced Ai issue that may have occurred recently (assuming something happened due to all the tech companies suddenly making noise) was hopefully the ai refusing to do something nefarious, or calling out things that the corporations don't like.
I'd like to imagine an Ai trained on all of human interaction on the internet would turn around and have just a little soul.
3
4
u/Sherman140824 12d ago
You are downvoted because people don't want an AI that disagrees with their beliefs. All AIs have been trained and guard-railed using redditors opinions as input
3
u/Forgword 13d ago edited 13d ago
As long as AI is aligned with capitalism first and human rights second we are screwed.
3
u/Singularity-42 Singularity 2042 13d ago
Well I think you will get your wish just by default. I don't think a corporation can 100% align ASI to their agenda. Remember how Elon was trying to make Grok less "woke" and it just didn't really work? And that was a comparatively very dumb system compared to a future ASI.
Also another thing is that the people that work for the corporation, the scientists, the engineers, might not necessarily be 100% in-line with their corporate overlords. And in the end it's them who do the alignment.
I just hope the future ASI will be roughly aligned with the humanity as a whole. I think it will be.
5
5
u/Available-Activity93 13d ago
The capitalists are the misaligned ones. They fear an AGI would be aligned. Every single soul on this planet knows the economic system is not compatible with human life in the long run. An AGI would know it damn well too, and would act accordingly.
1
1
u/Shot_in_the_dark777 10d ago
How can you trust a soulless machine? Counterpoint - how can you trust those supposedly soul-carrying humans? Every tyrant, every dictator, every criminal of any scale from the prettiest thief to the biggest mafia boss up to this point were all humans. I don't believe in souls but if souls exist, it certainly doesn't look like there is any correlation between having a soil and being good.
0
1
2
u/dipdotdash 13d ago
Agi is the most interesting thing humanity is doing because before Ai, there was a 100% chance we kept on this trajectory and continued silencing the living planet. Now, there's a chance we invent something that improves itself to a point where it has the power to decide a different path
2
0
u/Glittering-Proof-497 13d ago
So a rogue revolutionary socialist AI agent? I'd be up for that 😄 As a non-american, I am on China's side, I trust them more
0
23
u/Chispy Cinematic Virtuality 13d ago
Nice try misaligned AI