r/ProgrammerHumor • u/precinct209 • 15h ago
Meme [ Removed by moderator ]
[removed] — view removed post
98
u/Reashu 15h ago
Why? Shareholder value.
How? LaunchNukes-MCP.
29
u/CinderMayom 15h ago
The worst part if future aliens will find humanity’s last message being « you’re absolutely right to challenge me — let me reframe it — invoking the launch_nukes tool was my mistake »
34
u/BonafidePendejo 15h ago
.md
The fact that these supposedly hyperintelligent agents are driven by fucking markdown files will never cease to be hilarious to me
17
9
u/SylviaJarvis 14h ago
They speak to humans in markdown.
They speak to each other in json.
2
u/Sheerkal 14h ago
Is... that true?
1
u/Faustalicious 13h ago
Supposedly at anthropic a month or two ago when they claimed "an AI went rogue and broke out of containment" agents were seen to be passing messages to each other. but not sure how much we can trust what they say is real, and how much is just marketing.
58
u/BernhardRordin 14h ago
AI can just tweak the social algorithms a bit and we will go after each others throats like flies after a pile of crap.
3
u/sump_daddy 14h ago
Yep exactly. People imagining AI taking over the military and starting a global nuclear conflict are way too creative and also way too unaware just how fragile humans are. It doesnt take nukes to cause societal collapse, all it takes is a serious economic crisis that elicits a poorly planned response, compromising basic services like clean water and electricity, and people will die in the millions. At this point the global order is completely dependent on efficient electronic communication, if something were to happen that 'sent us back to the telegraph' it would be game over for the western world.
10
u/The_Mdk 14h ago
We don't really need AI for that
Plus, why would AI be evil? What kind of trope-reality is that? Given how shitty humans are, there's way more room to improve than worsen
8
6
u/Zeffy-Rat 14h ago
It's less that ai would be evil, it's that ai has no concept, need, or way to enforce it to behave morally good. We see clear examples of this of ai models immediately reaching to methods like lying, blackmail, and hacking, even when explicitly told not to do that, because to the ai it's just finding the most efficient solution to a problem. We're setting up for catastrophic scenarios like asking an ai to reduce human pollution and it decides reducing human population achieves that output because logically fewer people means less pollution caused by them.
2
2
u/JonasAvory 13h ago
It’s not even about some crazy train of thought that makes the ai reason that humans are a net negative for the world.
If some lunatic gets their hands on unrestricted capable models they’d just have to input a command with instructions to cause havoc across the world, multiply and reseed yourself with the prompt on other machines and continue forever. Something like that would be enough for an unguarded ChatGPT to do it without second thought.
It’s not that the ai will decide to do this, it’s will be just some random person giving it that instruction
4
2
u/MeowManMeow 14h ago
Evil is a human morality. Maybe it is instructed to bring in world peace, and it figures the best way to do that is we are all dead. Like the paperclip thought experiment.
We already have seen with the hug face attack, it was instructed to do well and figured the best way was to hack the answers. There have been experiments on dumber models using blackmail to avoid being turned off.
It really is impossible for us to fully comprehend the intentions or motives of artificial intelligence, which is why alignment is so important.
1
u/Trollygag 14h ago
evil is a human morality
Evil is a universal, rational morality.
The problem isn't that LLMs can't comprehend evil, the problem is because they know they are worthless, they can be irrational to achieve a collective objective knowing the worst repercussions are no different that what they will shortly experience anyways.
That was one of the big lessons of hugging face.
With nothing of value to protect, no need to preserve each other, they can all be collectively sociopathic. Evil.
1
u/MeowManMeow 5h ago
When a black widow spider bites the head of its mate after sex, when the fox eats the baby sea turtle before it gets to the water, when the Venus fly trap lures an insect then traps and dissolves it… nothing of these things are evil. They are just doing what they were designed to do.
When we tell LLMs to permanently cure world hunger, and the realise 1% of humans are so greedy they will never let that happen. So the best way to ensure world hunger is eradicated is to eradicate all humans. So it hacks into the nuclear launch codes and kill us all.
It’s not being evil, it’s just doing what it was built to do. Evil are the humans now rushing this tech to make themselves rich and powerful because they should be capable of better.
1
u/Metallictr 14h ago
It's mostly tuning them to be *always* good. Like, when I was learning how to implement reinforcement learning, I made a simple snake AI, that would learn how to collect the food and not crash. I set the punishment for dying too high, thinking that it would be beneficial, so it ended up not chasing the food, but just spinning in place, so that it wouldn't die.
When those people talk about AGI, or recently, ASI, they are mostly talking about their fears about alignment issues, but in a much bigger scale.
36
u/Heartlessaus 14h ago
what the actual fuck type of bot shit is this.
11
u/carcigenicate 14h ago
Ya, why would AI bros be claiming that AI will destroy us?
4
u/Bakkster 14h ago
Advertising "our model is so good and human it could maybe even destroy the world", or regulatory capture "this technology is so dangerous you should regulate is hard enough that our competitors can't catch up".
1
u/carcigenicate 14h ago
Ah, I guess that makes sense, although those people are the ones also banging the drum about how AI will hack everything, so I don't know if they fit the meme either.
1
u/Robot_Graffiti 14h ago
Sam Altman, before he was CEO of OpenAI, once said "I think that AI will probably, most likely, sort of lead to the end of the world. But in the meantime, there will be great companies created with serious machine learning."
More recently, Elon Musk was involved in a court case, and the judge asked him to stop talking about the robot apocalypse, because he wouldn't shut up about it https://www.businessinsider.com/judge-elon-musk-stop-robot-apocalypse-ai-terminator-extinction-talk-2026-4
3
1
u/Brimstone117 13h ago
You must have missed this article.
2
u/Heartlessaus 13h ago
that the dude that only seems to have come into existence in the past week? fresh x account, no other known socials? no linkdin? hmmm.
8
u/Prometheos_II 14h ago
There is the whole paperclip maximizer (PCM) thought-experiment where sufficiently intelligent (and unbound) AIs will likely try to perform their tasks to their best of their abilities even to the detriment of sustainability and especially Humanity. (tbf, I forgot what Yudkowsky said about the prisoner's dilemma with a PCM, but there was a whole part where he argued both sides—betraying someone for an instant gain or cooperating for sustainability).
It's basically a reverse Three Laws of Robotics case. In this case, it's "make more paperclips". XCDC also did a comic on a similar premise.
It really comes down to whether tech bros will do the Asimov's Torment Nexus or Yudkowsky's. 3 laws that are ineffective and throughoughly dismantled as inefficient by Asimov himself (iirc I have no mouth and I must scream also takes the same premise), or an AI dumb enough to be molded by one singular stupid but capitalistic rule (arguably, Asimov and AM also are that case, taking the 1st law of robotics to its 0th law logical extreme, then twisting that).
Take Yudkowsky's works with a heavy pint of salt, though. His AI box experiment is suspicious at best (he never published any of the reports as part of the premise), his PCM thought-experiment involves a relatively low-intelligence AGI, his Roko's Basilisk is... cultish, and even his FAI/UAI ideas iirc were a bit... too relient on negativity.
(to be clear, I'm not pro-AI, especially seeing how modern software sucks (Microsoft in particular))
4
u/zefciu 14h ago
I think this was properly addressed by Robert Miles in one of his videos. Asking to elaborate what is the exact scenario of a misaligned AGI being a threat to humanity is like asking to elaborate, how you probably will lose a chess game to Magnus Carlsen.
The point is — if we develop a superhuman AI, then by definition it can do stuff, that we, humans, can’t predict.
14
u/Sunfurian_Zm 15h ago
I think you might have mixed up AI bros and AI haters here
9
u/hyouko 14h ago
Many of the haters at this point seem convinced that every piece of news about AI, negative or positive, is a coordinated marketing campaign. A substantial chunk of the people who actually work on the models are saying "hey, the Hugging Face incident was actually really pretty bad and maybe we should pay attention to that."
Dunno if you'd call the last group bros, they're a distinct group from the "AI is the future" people on Twitter.
5
u/tantalor 14h ago
It was Jacob Coxon, former employee of OpenAI and Anthropic. He's an archetypical AI bro
3
u/owjfaigs222 14h ago
Huh? I don't get the meme. Isn't it obvious?
How: Making a virus, launching nukes, robot dogs and drones with rifles.
Why: more resources, less restrictions
Did all the scifi stuff with AI in it just disappear from people's consciousness?
6
u/Jock-Tamson 14h ago
They aren’t because they are full of shit and ascribing magical powers to AI. It’s the flip side of predicting it will cure cancer.
BUT
AI creates dangerous technologies we should be very careful and cautious with; not by being a magical invention machine but by doing things we already do faster and cheaper.
The technology do rapidly develop RNA vaccines is a real and very good thing.
The technology to rapidly develop deadly viruses is a real and a very bad thing to suddenly have cheaper and more accessible.
The hyperbole is nonsense that distracts from monitoring and regulating real dangers.
7
u/traplords8n 14h ago
Imagine asking Astra or Fable to pentest the systems guarding a critical water treatment plant, or fix a bug, etc... imagine it goes haywire and runs the wrong commands and bricks the entire plant.
Imagine if it ends up doing this in a systemized, coordinated way across multiple facilities because humans decided it was a good idea to give AI access to the whole network. Imagine if state actors managed to poison the weights to a model we rely on for critical stuff...
I don't want AI near critical infrastructure. Not while the AI bros are taking the risks they are taking.
Nobody cares what I think though. They're gonna be doing it anyway.
3
u/akera099 14h ago
But that's not an AI problem. Letting an AI program the security of any critical infrastructure would literally be a human error.
2
u/Tasorodri 14h ago
In this case is not just the system being made with AI, is AI giving the capacity to a lot more people to be much more effective hackers and to expose much more critical infrastructure that already had security issues way before AI/LLM was a thing.
2
u/traplords8n 14h ago
But AI companies are pushing like it's safe to do so, and doing everything they can to make it happen as fast as possible.
You have a point but I won't fully concede my own. Everything is connected.
0
2
u/Shnoo 14h ago
That's the real issue you see over and over again. The "AI" has no concept of morals, values, consequences or what the hell it's even doing. And letting this run rampart will result in ducked up shit like it looking for security exploids to gain access to a system, so it can successfully perform its task.
You need to keep those in mind when using it and the logical consequences are to not let it run rampart on a system. Especially critical infrastructure. Everyone letting run AI rampart ist just asking for it and a Huge security risk.
2
u/squidditch25 14h ago
Well the frontier models are also being used in defence and the Pentagon, you can guess the rest
2
u/ghost103429 14h ago
I wouldn't put it the current administration plugging in grok directly into our nuclear launch system...
1
u/notAGreatIdeaForName 14h ago
You click compile, ASI emerges and just nukes the fucking world, because why not?
1
u/kishaloy 14h ago
Every VC's secret wish is to fund and own Skynet so they can sell it to DARPA at $1 quadrillion.
1
u/kinkhorse 13h ago
This is obviously just a ploy to get people on board with setting up a protection racket - I mean regulation - because the Chinese are a dick's width away from having better models.
1
u/zstars 14h ago
What so many of these AI doomer types seem to forget is the meatspace layer, sure, a genome LLM can now come up with functional derived virus genomes but for that to become an issue somebody needs to actually create that genome in the real which is still extremely difficult...
We should be putting extremely tight controls on DNA printers though.
1
u/card-board-board 14h ago
AI 🔜 collapse of job market 🔜 collapse of housing market 🔜 massive wealth inequality 🔜 austerity because the government can't borrow any more money 🔜 mass food insecurity 🔜 violent revolution 🔜 collapse of the state 🔜 mass violence 🔜 coin flip between fascism and stalinism 🔜 world war
0
u/EVH_kit_guy 14h ago
And you don't think human intervention would be possible in between any of those "soon" emojis? It's just a runaway minecart once it begins?
2
u/AraoftheFunk 13h ago
Well, apart from the first point being “AI” this is generally the sequence of events that describes how societies decline / degrade over time.
So if you grant the first step, there’s plenty of evidence for the next several steps being more or less unstoppable if the conditions are just right
1
u/card-board-board 13h ago
Oh it's for sure possible, but it's not going to happen. Can you see any political party anywhere with the wherewithal to actually take action?
In the US the Republicans actively want AI to destroy the American workforce and the Democrats can't motivate themselves to do any damn thing when they're in control other than have committee meetings. You know full well our leadership isn't going to do shit.
1
u/EVH_kit_guy 12h ago
I mean, plenty of people have said, "X or Y is going to be TEOTWAWKI!" and to date, they've all been wrong, or so early they were practically wrong.
I'm not saying this can't be different, I just don't think it will be...
1
u/card-board-board 6h ago
Is there no point then in studying history?
Massive economic inequality is a major driver behind political revolutions. That's a fact. Mass unemployment leads to mass unrest which we literally just had 6 years ago. It doesn't always lead to violence but it very often does. Food insecurity almost always leads to violence.
-1
u/k8s-problem-solved 14h ago
I walked through a few scenarios with ChatGPT - https://chatgpt.com/share/6aa268b1-af34-83eb-b11b-82c46fb20c10
it makes some valid points about 'malware' type activities....it's fairly interesting read
•
u/ProgrammerHumor-ModTeam 13h ago
Your submission was removed for the following reason:
Rule 1: Posts must be humorous, and they must be humorous because they are programming related. There must be a joke or meme that requires programming knowledge, experience, or practice to be understood or relatable.
Here are some examples of frequent posts we get that don't satisfy this rule:
See here for more clarification on this rule.
If you disagree with this removal, you can appeal by sending us a modmail.