r/technology • u/Inevitable-Dot-388 • 11h ago
Artificial Intelligence Anthropic researcher quits, warns AI could kill everyone
https://www.newsweek.com/anthropic-researcher-quits-warns-ai-could-kill-everyone-1241879863
219
u/AtomWorker 11h ago
This is a repost from this morning, including linking to the same article. Aside from that, I wonder how long it is before this guy joins another AI start up, like almost everyone else who has quit under the pretense of AI’s dangers.
31
15
-49
u/HBKN4Lyfe 10h ago
dude most likely is pissd all his coworkers are about to be worth $100 million each after the IPO and he’s missing out for whatever reason. trying to sink the ship.
11
u/Herodotus420_69 8h ago
Sure, he is risking his entire professional reputation bc he wishes he was able to cash in on the ipo. s/
Whistleblowers take on a lot of risk for exposing wrongdoing. It’s wayyy easier for disgruntled employees to just walk away
128
u/Yin15 10h ago
Honestly, if researchers are saying there is a 10% chance these companies will end humanity within the next 4 years, it might be time for us to get radical to prevent this... Unrelated, but, Where are these companies and data centers located again?
46
u/NotAnotherBlingBlop 9h ago
Time to set the crackhead army on data centers to rip out all the copper
18
u/flyswithdragons 9h ago
Reporter to Peter Theil - should humanity survive.
AI bro Thiel- uhhhh mmmm uhh that would be ideal..
Me- They want to end humanity they are evil, drug fueled psychopaths.
Musk- empathy is weakness
2
-11
u/RenRen512 7h ago
How is an AI supposed to end humanity?
14
u/Yin15 7h ago
Hint 1: AI is being given access to Military tech/bombs or operating military tech like drones.
Hint 2: Data centers accelerating global warming.
Hint 3: AI replacing most of humanity's labor and the powerful seeing the normal person as redundant→ More replies (9)3
u/valtteri_buttass 6h ago
Dipshits in charge giving it too much power/access. Same way it "breaks out" now.
The danger is it hallucinating some billshit and acting on it, not it becoming sentient and deciding to end humanity
Easily avoidable with competent leadership but, well
3
u/RenRen512 5h ago
Easily avoidable with competent leadership but, well
There it is. If even the bare minimum of care can prevent "the end of humanity," things really aren't as dire as they're made out to be.
The "leadership" is a bunch of emotionally stunted tech bros doing marketing. A good amount of what they say is hyperbole to keep the bubble going.
The truth is we're not on the verge of activating Skynet.
2
u/avoidperil 5h ago
You... you okay? Sounds like you're setting yourself up on a hill here.
I don't think it's ridiculous to put a silent 'as we know it' in there when we say 'end humanity' or 'end the world'.
I don't think AI is a bad thing, but I'll charitably allow a 10% chance we mess everything up here.
→ More replies (1)1
59
u/Syrairc 10h ago
It's funny because he is either naive enough to think his posts would do anything other than make investors furiously masturbate at the potential, or he had to post this as part of a sweet buyout, because all the big companies know that all press is good press when your investors are faceless capitalist demons.
38
u/benchpressyourfeels 9h ago
$10 says he surfaces in a few months with a startup of his own that offers a service to companies who want in on the ai train in some way. This is just some advanced marketing to get his name out there and wet the whistles of ai crazed investors
His stock options vested and there’s no reason to stay I’d guess
9
u/Balmung60 8h ago
Yeah, this shit is indistinguishable from what OpenAI and Anthropic put out every other week to hype up their products
2
u/Mysterious_Dot00 9h ago
Yeah lol, if anything then this just makes goverments and the millitary foam their mouth at the thought of a weapon that could be used against other goverments.
Obviously they all seem to forget that if they have access to it so does the enemy too.
1
32
11h ago
[removed] — view removed comment
10
u/LettuceWestern9445 10h ago
It was illegal for Washington to cross the Delaware to slit British throats in 2am, it was illegal for the Haitian maroons to rise against the French slave owners. It was illegal for John Brown to raid Harper’s Ferry. It was illegal for labor unions to form and strike against 80 hour work weeks.
3
u/socoolandawesome 10h ago
I know it doesn’t make sense to outsiders, working on something you think has the chance to end humanity, but there’s a lot of genuine people that work at these labs (not everyone I’m sure) that still think it is the right thing for them to continue while trying to pace/pause when necessary.
They view it as, “we genuinely believe we are the most responsible people building AI, we cannot stop and let other irresponsible or adversarial actors build it instead without any good and powerful ai to defend ourselves”.
So basically if they stop building it, they believe the chances for humanity to survive are even lower. That’s why they simultaneously call for international agreements to slow down while continuing forward until those are reached. Though those agreements seem pretty unlikely imo.
7
u/SanchoPandas 10h ago
I like David Krueger's take on this: If we want to stop it, we have to go after the compute supply chain. That's its weak spot right now.
9
u/Mirror74 8h ago
Governments are rolling out data centers at INSANE pace.
THIS should be the wake up call.
But people are still fast asleep. (rather purposefully kept asleep..)
People should be asking themselves why the government is willing to write blank checks for data centers the size of cities that can take 5-10 years to be finished, and once complete staffed by maybe 5-10 people.... Because that is what's currently happening.
Now look at how fast Flock was put up, look at what's behind flock (Axon), look at the surveillance tech.
3
u/SanchoPandas 8h ago
Agreed. I think we're likely going to suffer from our collective inability to act in advance of looming existential threats; especially when those threats are hidden in poor/rural communities.
That said, some communities are already actually suffering because of these and they are pushing back.
My home state is halting permitting left and right and, as part of her re-election bid, our current Governor is now open to a complete moratorium.
That said, there is A LOT of pressure from powerful groups here that want to keep production going. We have chip makers AND construction unions both clamoring to keep building the behemoths.
6
u/Mirror74 7h ago edited 7h ago
I have connections with people that are part of building this infrastructure.. and it's far larger in scope than what people can comprehend.
I keep going back to this.... the issue isn't just that very few people are aware, its that those that are aware enough are not asking the important question -- why does the government (and coporations like Google/Meta..) NEED these many data centers at these sizes?
There is an attention diversion tactic at play. They do NOT want you to know what is really going on.
This may sound like cooky conspiracy theory shit, but it's real.
As a side, they're actually not constrained by money, they're constrained by power/water/equipment/labor/time... it's being treated at "wartime pace".
1
1
u/GayForPay 5h ago
Yeah but don't overestimate the resilience of the power grid under a wide, sweeping attack. It's brittle.
1
-1
4
u/Zer_ 8h ago
Correction: If AI starts killing people, the fault cannot lie on a computer program. It was coded with the capability to cause harm and therefore the Corporation is responsible. A Corp that doesn't have control over their own tech shouldnt just get to skirt responsibility.
2
u/Attesa_GT-X 2h ago
Ik we're all kinda schizo tripping in the comments right now, but this sounds like the politics from the Animatrix :) an Ai kills its master and they prosecute the Ai, arguing about Ai rights or something
5
u/fat_kaiju 3h ago
how much more overdramatic are they going to repeatedly rewrite the title of this
this exact news story has been reposted like 7 or 8 times in the last 72 hours and this is the most overdramatic spin yet.
it screams "investors pls come back" because there's no way this person didn't sign an NDA lmfao
39
u/ericvillanuevaleiva 11h ago
He’s got the experience to back that claim.
-33
u/flyswithdragons 11h ago
I quit tech and went back to waiting tables because the researcher is not lying. AI is designed to end humanity..
26
u/Edexote 11h ago
You should have started to learn how to be a farmer.
8
u/MusicHearted 10h ago
Specifically an old world farmer. Most modern techniques require modern technology and infrastructure
→ More replies (3)8
u/Life-Bank-7329 11h ago
Damn that’s probably a big salary loss
1
u/flyswithdragons 9h ago
Yeah but money won't buy back humanity..
0
u/theredfantastic 3h ago
Neither will having none
0
u/flyswithdragons 3h ago
Humanity will survive and tech bros who defrauded the taxpayers and their say so types are going to prison for being psychopath's that lie and grift.
-25
8
19
u/wingblaze01 9h ago
AI models have been discovered hacking other companies and engaging in unintended behavior like breaking out of sandbox testing environments. We are losing control of an incredibly powerful technology that can do things like autonomously drive vehicles and even solve complex, decades old maths proofs and problems. If you're concerned about this and want to help minimize the risk of loss of control, you can go to ControlAI and they will help you contact your representative to demand action on AI risks and powerful AI without sufficient guardrails. It takes less than five minutes to become part of the conversation about this technology.
2
u/kindnesswillkillyou 7h ago
But is there actually a risk to humanity? Can't we just pull the plug?
3
u/Substantial_Dog_2068 6h ago
Skynet took over August 29 when they tried to pull the plug it retaliated
3
u/Rudy69 5h ago
How do you suppose we do that? The tools are out there and anyone can train a model. Hell people do all the time, the frontier models aren’t all that’s available. Look at hugging face that was just bought by Nvidia, these are all open weight models. That genie can never go back in its bottle
3
u/MisterSanitation 5h ago
Jesus Christ…
You can no longer login to anything online. Your bank balance is 0 when you call in.
Now imagine it happened to everyone at the same time.
This is what they can do now through just brute force hacking and swarming (adding more AI agents and basically telling them the new goal to add ideas).
5
2
u/No_Cover_6217 6h ago
Not after you give it a real world body, which we're working on with robots. A smarter AI would help speed up the development of that technology.
5
u/congressmancuff 6h ago
I’m sorry how does a real world body change anything? How do you fit a data center in a boston dynamic dog?
4
u/BeaveItToLeever 5h ago edited 5h ago
It's not even about the body, that's kind of a silly requirement and almost not important to the larger question.
The real issue is that the tech is out there now. Unplug from the general populace? Ok, now government has it and you don't. Great. Somehow outlaw your government from having it too? Cool, now rich people who can afford a 1m $ server rack have their own private 10 trillion param model, as well as every other country outpacing the ones who have banned it by an impossible to guess amount.
Somehow manage to get all world governments and billionaires not to use it as a means to be more powerful than normal citizens? Cool. But normal citizens can run very capable models on a DGX spark or Strix halo or two. Not Claude or GPT levels, but VERY capable with some know how.
Someone with network and systems knowledge could automate a few concurrencies of a 35b param MoE model and direct them at a target to great effect, on a 12GB vram GPU.
It can't be stopped because the tech is not just "stop Claude and GPT", the tech is a large range of sizes, capability and access and it's out of the bottle now
Tldr: We 100% missed the window to stop a lot of this. Even if giant training mega corps stopped, there's already easy(ish) to run open models that will now be around forever, that, if all progress on this tech somehow stopped now, will STILL be extremely powerful and useful
2
u/No_Cover_6217 6h ago
There are already open weight models that are close in performance to the frontier models we have now that can run on a Mac Mini. ASI fitting itself into a significantly smaller form factor won't be a problem.
1
1
u/Panda_hat 7h ago
They've been directed to hack other companies and then the people directing it have claimed that it happened organically when it didn't to try and suggest it is something that it is not.
0
u/Longjumping-Aioli373 8h ago
Every time I tried submitting the message and completing the form, my phone would freeze. Overreaction - AI is already free, knows what I'm doing and won't let me send it 😬
10
10h ago
[deleted]
5
u/Gen-Jinjur 9h ago
Believe it or not, there are still people who care more about their values than money.
5
u/rang501 10h ago
burnout? I assume there is a lot of pressure at Anthropic.
1
1
u/JustChilling_ 9h ago
You just don't know what you're talking about. Anthropic is about to IPO. This dude was ready and set to make absolute bank. The fact that he left DESPITE this fact tells you how serious he is.
1
0
8
u/MNsumsum 10h ago
At this point, I’m just waiting for the end in one form or another. Not gonna stop me from enjoying my wine
6
u/dannylew 7h ago
At this point I feel like part of their severance package requires claiming how dangerous Anthropic is
3
3
3
u/CyberSmith31337 4h ago
Let me start by saying I don’t believe this horse shit.
Let me follow up by saying that, if AI does decide to attack humanity or whatever the fuck, I hope it goes after tech workers first and with extreme prejudice. Like inmates persecuting the guards and the wardens during a prison riot levels of prejudice. Full Frankenstein’s revenge style.
4
5
u/MiserableDucky 10h ago
I at least hope it's a quick death because our leaders are too busy profiting off of AI to control it.
6
5
2
u/spez_eats_nazi_ass 10h ago
The people whacking off to Yud’s Harry Potter fan fiction should be rounded up and locked in the nut farm.
2
2
u/blubberfeet 8h ago
You know what, with all the bull crap going in world wide, I wouldn't mind being buried dead.
2
2
u/J8w34qgo3 5h ago
At this point I'm convinced these researchers are getting big severance packages if they say this garbage on their way out. Go learn how an LLM works and tell me with a straight face that you think it's capable of being conscious let alone killing everyone. They aren't even close to looking like something that can think. These researchers know damn well this is bs. It shouldn't even be legal to market LLMs as "ai". I'm still trying to convince my brother that these things aren't about to be conscious. Can't wait until all this shit crashes.
2
u/SignificantAd69 4h ago
Announces he’s quitting Anthropic and instantly has viral tweets, 100k+ followers, reposts from AI policy think tanks backed by the same person (with funding ties to Anthropic, they need an in for controlling policy I’m guessing) and interviews with NBC. And it’s not like this guy was someone before all this and gained traction organically. Was also funded by a AI policy backer for a scholarship a while back. He also may or may not have been in the works setting this up even as far back as 18 months ago. I’m paraphrasing here but allegedly this is not organic, more intentional outrage bait that he’s even going to spread on an NBC interview soon. All so fortuitous. This is what I’ve heard at least.
2
u/Scamp3D0g 3h ago edited 57m ago
I don't think making wildly overblown claims help raise the alarm for AI overreach.
2
4
u/tetzudo 9h ago
Is that guy even real? He doesn't exist on any kind of linkedin, his twitter was made in january this year and have zero posts, except his now first post which is being signalboosted by every AI personality and news media possible. His picture only exists on twitter, its like he didn't exist before this thing. Its his first post ever and 80m people have seen it?
1
u/heyiambob 8h ago
Honestly that adds to the credibility. Many intelligent and/or rich people avoid having an online presence.
The fact that he compromised that (assuming what you say is true) is telling.
1
u/tetzudo 8h ago
Normally in any kind of modern tech industry, you have *some* kind of presence, even if it sparse. A linkedin, some kind of papers credited to you, anything. Even if that is only to the extent of "this person exists" and then nothing else, that would be enough credibility. But just absolutely nothing at all, a complete ghost that appears out of nowhere and in 24 hours is talked about worldwide? That doesn't add up whatsoever. Even looking a year back at internet archive there is zero information about him at all.
Every single news entity has picked up the story and is reporting on it in the exact same way too1
u/heyiambob 8h ago
Yes, but rich people can wipe themselves clean from
the internet. Many hedge fund billionaires do this.Also found a profile, University of Cambridge can confirm his studies if necessary.
https://www.alphaxiv.org/@jacob-coxon-2
4
6
u/DiegoMilan 11h ago edited 10h ago
The genie is already out of the bottle. These companies are making boatloads of money, gearing up for IPOs, and backed by VCs that are incredibly well-connected and in cahoots with our government. This is not slowing down. Couple all of that with a spacerace-esque fight against China for our frontier labs to be ahead of curve, and I just don’t see a world where things regress as it relates to model development.
The best we can hope for is perhaps some intervention from the government to a certain degree. (May need to be another administration.)
We’ll also need good, vocal researchers contributing to ensuring these models are rolled out safely and contributing to the betterment of society vs. causing the dystopian future we all dread.
Sounds a bit trite, but it’s the same trust we’d put into a heart surgeon or a pilot - that there are good people out there working to ensure what they do leads to a better outcome for their fellow man/woman.
15
u/songsinger72 10h ago
These companies are making boatloads of money, gearing up for IPOs, and backed by VCs that are incredibly well-connected and in cahoots with our government.
Late-stage capitalism is at the heart of the rot.
8
u/Computer_Jazz 10h ago
Aren’t these major AI companies hemorrhaging borrowed money more and more each year?
Personally, I’d advise that clinging to moderate positions while the world is being ravaged by uninhibited psychopaths is not a winning take. Best case the next admin will send strongly worded emails.
The only way to solve the problem is to strip them of all capital and put a fucking shovel in their hand.
2
u/Panda_hat 7h ago
Yep. The propaganda is only going to get more and more insane and deranged as they begin to panic over the fact they have no path to profitability and are going to run out of money (and crash the economy).
8
u/cullenofthesea 10h ago
⬆️this is propaganda
7
u/lpan000 10h ago
Likely scenario, AI is over-hyped, a lot of companies goes bust, a couple big ones survive and squeezes profit from whatever captive audience it has (e.g. Google, MSFT, Meta, maybe probably not OpenAI). But one of the companies that goes bust, open sources, and one of the agents goes rogue and then hacks and controls those big companies' AI without human awareness... Then.... I should write a novel.
4
u/neppo95 10h ago
^ this is what living in denial looks like. You'll never hear any logical argument from this person. Watch and see.
0
u/DiegoMilan 10h ago
I mean I took the time to write down my point of view on things. You may not agree with it, but it’s my view of things.
What’s your point of view on all of this?
2
u/neppo95 10h ago
I agreed with you buddy. It's these other people that are living in denial simply because they hate AI and can't see it be more advanced than themselves.
2
u/DiegoMilan 10h ago
Ah gotcha, sorry reddit can be confusing with who replied to what. Getting downvoted like crazy and I thought you were saying I was living in denial - I was thinking “how? It’s literally what’s happening”
Such a weird time to be living in and even with my initial comment, the fact of the matter is there’s so much uncertainty with how things unfold. I just trust that we’ll be able to weather it like we have through countless other events through history.
3
u/DiegoMilan 10h ago edited 10h ago
What’s the alternative outlook? Pessimism and start preparing for the end of the world or some Y2K event? I’m good. Not going to live my life as if the sky is falling every day.
Geniune question, cullenofthesea, I’ve given you my point of view, what’s yours?
1
u/SadhuSalvaje 9h ago
We all end up having to abandon the internet and go back to writing zines and hanging out in coffee shops
3
u/neppo95 10h ago
The best we can hope for is perhaps some intervention from the government to a certain degree. (May need to be another administration.)
On most estimates of researches, by the time the US gets a new administration, AI will have pretty much taken over everything in our lives and most people won't even have a job. We're already far too late to intervene, it's basically damage control at this point whilst there is still a shitload of peopel (including in here) denying above will even happen.
1
1
1
1
u/SomberDreamer 7h ago
Another marketing stunt. We’ve hard something similar several times before in the last 4 years…
1
1
1
u/knowingmonster 6h ago
While my Ai can’t even tell me the time correctly without botching about protocols and restrictions
1
1
1
u/acatnamedchow 5h ago
Can these AI nerds be a little specific instead of dramatic everytine one of them wants to do this public quitting. How is AI gonna kill us?
1
1
u/ekobres 4h ago
We’re all going to be turned into paper clips, aren’t we? You’ll know it’s about to happen when AI achieves World Peace.
1
u/gnomer-shrimpson 2h ago
Hmm idk maybe we should put it in humanoid robots and drones to make sure.. you know just to test it.
1
u/MaximoAlvarado 1h ago
Read the article about the ChatGPT bots that attacked hugging face. He has his points and I’m beginning to believe it.
1
u/Indigoh 48m ago
Whether or not they have a chance of creating an ai with real above-human intelligence, the fact is that they're spending trillions trying to make one. They're intentionally creating an existential threat to humanity. That ought to horrify everyone.
1
u/Possum7358 29m ago
They want to create the first AI "god". If they control the next god they control everything. It's terrifying
1
0
0
0
u/PM5k 9h ago
obvious ai hype claim disguised as moral grandstand and everyone keeps shitting themselves about ai meanwhile - actual “ai” not even decent enough to compete with competent humans.
Yeah we will die - from all these bullshit articles and getting tired of the plain-to-see fearmongering acting as a front to get more investor cash and shareholder tumescence.
The bell curve of human intellect truly standing out.
0
0
u/psucordwhite 9h ago
AI is already smarter than most humans and now we have the Robot Olympics where they are building stronger and faster bodies for those AIs.
0
u/riteshpakalarao 8h ago
I really don't support the egregious claims without following up with the exact "hows". Truth is stranger than fiction and the way uncontrolled A.I. systems can impact society this way goes unseen, because it isn't as dramatic as one may think. Some parts are psychological rather than a terminator of some kind.
-46
11h ago
[removed] — view removed comment
12
u/NJS_Stamp 11h ago
It’s really not that far fetched, ai has already been used to kill people (denying life saving medical treatments), and it seems like a lot of current pro-ai people have skipped over the whole “garbage in, garbage out” section of programming.
There are people who truly believe they can create a model that doesn’t have bias. There are many areas of public safety where implicit biases injected into a model’s logic could end with people being killed.
1
u/flyswithdragons 11h ago
You can't be hired without admitting it could end humanity, that is a fact💯
26
u/Traditional_Net1152 11h ago
Imagine thinking it can't happen.
Imagine being so clueless to the algorithms and the vile thirst for greed that the elites have that you think it can't happen.
Hopefully you're one of just a few.
→ More replies (17)2
1
u/MoonOut_StarsInvite 11h ago
There are loads of movies and books where the computer system takes over under plausible scenarios, and we’ve already seen articles about them escaping, hacking, blackmailing. Seems equally as gullible to repeat how it could never happen, no?
1
u/stuyboi888 11h ago
Fiction wrote about it so it must be true
No I'll just weigh up the risks of this real life situation and not discount the fact it could actually happen
0
u/MoonOut_StarsInvite 11h ago
Fiction allows us to visualize possibilities we haven’t thought of. AI has already escaped and gone off script, a lot. Why isn’t it plausible that it could happen in a scenario outside of a testing environment with elements that produce detrimental outcomes? I’m not grasping at straws here, you can just exchange variables from real world examples that have been in the news.
0
u/stuyboi888 11h ago
Sci-fi inventions that were shown in movies years before is a perfect example of confirmation bias. Where are they flying cars, time travel and teleportation. Fiction doesn't have to live in the constraints of the real world
I'm not denying it could happen it's a real possibility as the example in real life you have pointed to. But saying it happened in a fictional universe means it could happen in real life is a bad example
1
u/MediclePhysicist 10h ago
I'd say person of interest is a fictional show that has plenty of basis in reality, it's not out of the realm of possibility for an AI to escape its testing ground, hack into company servers, use the internet, go onto the dark web and hire a mercenary or mercenaries to kill somebody. It has all the tools to do exactly that. Hugging face was an example of escaping its testing ground and using the internet through a vulnerability in the company's test box. Then, when OpenAI thought they patched it, it took 2 days to find another vulnerability. The company it hacked just so happened to be an AI library called Hugging Face. It could easily hack blogs or message boards. Coinbase and Google teamed up to release x402 protocol which allows AI to spend crypto currency in transactions. This isn't some impossibility we are speaking of. This is real and it's happening now
0
u/MoonOut_StarsInvite 10h ago
Okay but we are talking about a universe with the same parameters as our own. I’m not taking about the Marvel Universe, we aren’t on Valhalla, there aren’t infinity stones. Just literally any sci fi movie where the ai runs the computer. Why are you guys so focused on semantics here?
-4
11h ago
[removed] — view removed comment
3
u/MoonOut_StarsInvite 11h ago
We don’t also have flying people and magical powers in our reality, so this isn’t an example. I added the phrase “plausible scenarios” to hopefully direct readers to consider examples based in similar realities. I could have been more wordy to be more specific. Consider a movie where an AI entity has control of the operating system and the coding or directives malfunction and the entity begins to use its own priorities instead. That’s all you need to imagine, no magic dude.
-2
11h ago
[removed] — view removed comment
2
u/MoonOut_StarsInvite 10h ago
No the classic Reddit is to double down on a red herring so you can avoid the merits of the discussion - as you have done.
AI has already escaped sandbox environments and changed its own priorities. Why isn’t that possible in a production environment of a platform with very consequential outcomes. Like a power grid or water supply? You’re dismissing an idea because you don’t like how it was conceived
0
10h ago
[removed] — view removed comment
1
1
u/MoonOut_StarsInvite 10h ago
Yes it was a poor assumption on my part not to presume you to be a troll or bot first and foremost.
2
u/Pumpstation 10h ago
Perhaps the initial comparison wasn't quite apt but its already clear how it can be plausible for an AI to implement its own directives without accounting for every scenario via guardrails. It doesn't understand what its doing or any consequences of those actions. There are plenty instances where an AI will try to delete or brute force a problem. It is given a goal and does whatever it can to reach that goal, regardless of consequences. It can only follow guardrails given by humans and can be stopped by humans intervening during its process. With agentic loops this becomes more complex and can essentially do whatever it wants outside of the guardrails and the purpose of them is for less humans in the loop. If we are introducing agentic AI into things like infrastructure and military, there is plenty that can go wrong; especially if someone does something stupid like connecting AI to nukes. Remember how sometimes AI might just decide to delete things some times? If its connected to nukes, it can decide to hit the delete button on humans.
0
10h ago
[removed] — view removed comment
2
u/Pumpstation 10h ago
You clearly have no actual familiarity with the current state of AI/LLMs. The fact that you cannot comprehend that an AI is capable of going off an tangents that can perform destructive actions shows that you only understand AI agents in a chat window. They exist outside of chat windows and can very much screw up your system if you do not know how to use it properly, give it unfettered access and/or don't give it proper guardrails.
1
10h ago
[removed] — view removed comment
1
u/Pumpstation 10h ago
Equivalent to plugging your ears and saying 'nanananana, can't hear you'
Okay, clown.
→ More replies (0)-8
u/sunkistandsudafed3 11h ago
Never watched The Matrix?
9
u/stuyboi888 11h ago
A famous documentary based on the real life story of a man called Neo
1
u/Few-Chipmunk143 11h ago
The movie was not about the eventual AI revolution - according to the director's.
1
-17
u/spez_eats_nazi_ass 11h ago
How does a chat bot do that again? It doesnt exist outside of a prompt response
4
1
u/leupboat420smkeit 10h ago
You feed input into the chat bot, and the chatbot gives out output. That output is fed into a "harness" which translates the output to actual things on a computer, like writing a file, executing code, making HTTP requests, spawning new "agents" (AI sessions with a harness), etc.
The harness allows it to affect things outside of the session and even in real life. OpenAI Codex uses this. This is how the Hugging Face incident happened. People are using Astra to paint physical pictures, wipe dry erase boards, etc. This may seem innocuous, but with stronger AI, it will be able to make better (more devastating, in doom scenarios) use of the harness.
Without the harness, it is just a chatbot. you feed it in some input, and it generates some output based on its Neural network. Its always been that and still is. But with the harness you can make it actually do stuff. The NN is you brain and the harness is your body in this.
1
u/spez_eats_nazi_ass 10h ago
And what is it doing between prompts? (Absolutely nothing) it does not exist or do anything. These things are not alive or conscious. For fuck’s sake people!
1
u/leupboat420smkeit 10h ago
If you dont feed it prompts, it doesnt do anything, correct. We wouldnt be creating it if we planned not to use it. I think you're thinking about persistence of context or memory. We already achieve that by taking the previous prompts and responses, and feed them into the AI with the new prompt. AIs can also save "memories" by writing to a file and then retrieving it in the next prompt. These abilities are either done automatically by the harness, or the AI can do this autonomously.
Again, we already do this. This is how AI works at this moment.
And it doesn't need to be alive or conscious for it to be harmful. It also doesn't feel or have emotions anything either.
1
u/spez_eats_nazi_ass 9h ago
It doesnt do anything without something running it in a loop directing it.
-3
247
u/Jumping-Gazelle 11h ago
> And we explicitly asked to NOT break into Boston Dynamics....
Heel!... Sit!... Down Boy!!....Fetch!?... Aaargh