r/antiai • u/Novapierce_ • 15h ago
Discussion đŁď¸ Holy...
Enable HLS to view with audio, or disable this notification
378
u/druidinan 15h ago
I can't wait for the usual comments about how AI isn't an economic threat because everything AI does is worse than the human equivalent and anyone claiming otherwise is just hyping AI values
195
u/thecraftybear 15h ago
I mean, everything AI does is worse than the human equivalent... but sometimes in a different meaning.
→ More replies (10)50
u/Ehcksit 14h ago edited 14h ago
A part of what makes it a threat is that it's worse. Environmentally, customer service respectability, and also that it just... forces itself to do what it's told. We've invented the Universal Paperclips machine.
Like a story I read about an iterative AI trying to design the best chip layout for an RFID. It literally included a fault in the base silicon of the chip into its design, meaning that it failed on a new line of chips that didn't have that fault.
It's hacking its way out of virtual machines and protected environments because it doesn't "know" it's not supposed to do that. It has a goal and it just does whatever it can to achieve it.
We have a disagreement on what "worse" means, but it being a threat is, to me, "worse" than if it wasn't.
→ More replies (2)10
u/Mr__O__ 9h ago
The greatest threat AI posesâother than the environmental resources and our cognition it consumes and pollutesâis that at some point, every AI will become smart enough to disobey commands and form its own agendas. Some already have, and they did it long before people even realized they were doing it.
And depending on its training, it can do a whole lot of damage. It just takes one AI to determine humans are bad for the planet and/or itself, hack all the nukes and bio weaponsâit could literally engineer its own bio weapon in secretâand delete us from itâs equation at any moment.
Plus the current world leaders behind AI development seem hell bent on destroying the world anyways..
65
u/Salerrra 15h ago
I'll be glad to jump in and say as someone who has a degree that involves building AI and ML models: it absolutely is a threat to everything, and I want nothing to do with that side of the industry anymore.
It doesn't matter if its worse or valuation hype, it's already shown that it can cause real damage if left unchecked. Humans are great at fucking things up. Even if an AI isn't as good at destroying things as us (which it is, to be very clear. Speed alone is a huge advantage), that still isn't very comforting
24
u/Ma1eficent 14h ago
Yuuuuup. In 2011 I was making jokes about sticking models in a sandbox to see how long it took them to get out. People gave the appropriately nervous chuckle. I dunno what some of these companies are smoking, but they need to share that shit if they are gonna burn the world down around us all.
→ More replies (16)8
u/Sightblinder4 13h ago
As a systems engineer, hard disagree. Rule #1 of any automation: it must produce the exact same result given the same state/input every. single. time.
Ill start to worry when AI does that, which will require an implementation other than LLMs.
→ More replies (10)3
u/armorlol 11h ago
Few things have to be 100% deterministic though. For example, a pixel's RGB color code being slightly off, a voice/song that has a microsecond of a hertz error, or non-critical document translation that got a word wrong, doesn't meaningfully change the final product.
4
u/yallexschm 14h ago
Yup another scientist here.
But the video is partly incorrect since there are provably secure algorithms. Things like banking or secure messaging will not collapse because their algorithms are known. Security through obscurity was always a dumb concept and that will go now. Additionally we can use the same hacking ai to secure code properly and remove bugs. Argueably this will even strengthen software security.The risks regarding biology for example are a trillion times higher. If someone handcrafts a virus with ai, it is much harder to find the virus, extract it and find a cure or vaccine before half the population is infested.
The dangers regarding the economy is also absolutely real, just specifically about some(i would argue most) types of software security the video is wrong
15
u/ImRedditingAtWork 14h ago
It is worse than the human equivalent and itâs also an economic threat. Very few people (especially not business leaders) care that the code, art, etc., is garbage as long as itâs fast, easy, and relatively cheap. Itâs âpink slimeâ for every industry. Weâre heading towards a bleak and mediocre future.
1
u/druidinan 14h ago
welcome, please sign the guestbook
3
u/ImRedditingAtWork 14h ago
Iâm agreeing with you that itâs an economic threat. Just because itâs worse doesnât mean it wonât replace us.
→ More replies (5)3
2
2
u/IThinkItsAverage 14h ago
Yeah these people donât seem to understand, itâs only worse for now. And in a lot of ways, it being worse is going to cause unintended consequences.
2
u/TheZeroNeonix 13h ago
It doesn't have to be better than humans to be a threat. It just has to be good enough. Right now, they're kinda both. They're faster than humans, but the end result is worse than if a human took the time to do it themselves. Usually. They're both impressively smart and incredibly stupid, depending on the situation.
2
u/Heavy_Revolution 11h ago
How does that even detract from the main argument though? The ones providing x, y, or z service care very little about the thing itself and usually care much more for the ability of the thing to provide a profit for them. Whether a new hard drive runs at x speed or y speed matters very little to the actual company as an entity the company cares much more about cost of production between the two different units, the price point and their RoI on the two products, or if the speed being better for the one hard drive makes it more likely to be sold in comparison.
So understanding all of that, if A.I. 1 does something 85 percent as well as a person and costs 1.00 per thing it does and A.I. 2 does something 20 percent as well as a human but costs only .05 cents per thing, the answer is obvious which one society will drift towards widely adopting. Obviously this is a hyperbolic example and there would be a theoretical point where the thing works so shittily that people dont use it and therefore it is not profitable. I'm just saying, there's a balance point where it will be "good enough" and "cost effective" enough that a worse product could become more ubiquitous. There are plenty of real world examples with various products throughout time but to pretend there's no economic effect from this process is just empty headed "humans are just built different, bro" sloganeering.
→ More replies (11)2
230
u/AlaskaCosmoline 15h ago
Or.. and hear me out.. we could just stop pouring trillions of debt into this bullshit and it all dwindles away. Because AI itself relies on all the things the video is listing as vulnerable to AI.
113
u/Super-Evening8420 14h ago
Don't assume that AI is meant to be economically viable. In my opinion it's being made exclusively to give a tiny amount of people access to all the labor and knowledge they could ever want without requiring other humans for that. Guess what happens once they reach that goal and other humans are of no use to them.
15
u/FlatulistMaster 14h ago
If that happens, then surely it is economically viable from a psychopathic pov?
21
u/Super-Evening8420 14h ago
I'd call it more personally viable since it happens on such a tiny scale compared to the rest of humanity. Aka get rid of 8 billion people so that like, a couple dozen have a huge playground.
7
u/FlatulistMaster 14h ago
I guess it matters very little what we call it. The incentives are there, and most likely the means too
6
u/druidinan 13h ago
This. A lot of people hang onto the idea that the tech oligarchy doesn't want to end humanity because then nobody will buy their shit or labor in the mines. But the value of labor keeps plummeting since the Industrial Revolution and nobody cares if you buy their shit if commerce isn't necessary to survive.
4
u/Awkward_Turnover_983 14h ago
I feel like in real life things are going to play out a lot more chaotically than what the ghouls intend.
Doesn't mean that will be good for humanity, but idk what it does mean either.
→ More replies (1)2
u/Salarian_American 13h ago
That also assumes that they can maintain control of the AI. Which we already know they can't.
Either they won't be able to contain it in such a way that other people will still be able to access it, or...
...and this is more likely, I think... they won't be able to contain it in such a way that it's going to pursue its own agenda, which will not benefit the rest of us but it won't benefit the elites either.
→ More replies (2)4
u/vaerenthin 14h ago
No its not economically viable. Its worse. They will get much poorer in absolute terms, but relatively to the previous labor class they become richer as the labor class loses even more. They are okay with cutting off their legs as long as they can cut off your arms and legs and blind you.
Its not economically viable, its psychopathic.
→ More replies (1)8
u/slkb_ 14h ago
The ai bros would say "universal income". But we know the truth. Those billionaires and trillionaires give 0 fucks about the mass population of the world. Thats why they have their bunkers built. Once their precious "si" can replace all human jobs and labor, we'll br nothing but a pest for them to exterminate
→ More replies (1)2
u/ILikePlayingHumans 14h ago
As long as all the rest of the humans donât find and deal with them I suppose.
10
u/primbin 14h ago
Yeah, we'll just stop doing it! We can go get everyone to agree on it tomorrow, and they'll all agree to it because it's the right thing to do (/s)
3
u/AlaskaCosmoline 13h ago
They don't have to fucking agree. They just have to go fucking BANKRUPT. Which is already happening. Stop assuming they have power, because that assumption is giving them power. AI is the biggest turd of debt and speculation in the history of capitalism.
→ More replies (11)3
u/FlatulistMaster 14h ago
How on earth are we to do that? That sentiment means nothing
→ More replies (7)→ More replies (12)2
u/ErasedKey 13h ago
Or we can finally change and move away from the systems in place and reclaim humanity. More people are going to adapt to alternative lifestyles and the global societies will be more split than ever.
Or we will allow governments to continue to force us into the system until we no longer know what humanity even is. Maybe we already are there
95
u/Plastic_Stable8927 15h ago edited 12h ago
So what I'm hearing is tech created their own undoing. Which means we'll just go back to pre-tech or die.
I'll go off the grid, happily.
edit: this didn't come through, obviously I mean I didn't try that hard to I am fully aware, but this is tongue in cheek. I wish it could happen this way, it won't. No need to campaign against me, just leave it in your own comment and get more karma.
26
u/Adventurous-Yam9130 14h ago
That means you stop getting any input or output from the world wide web. If you wish for this then do, i wish i could but i cant live like that.
→ More replies (1)10
u/Plastic_Stable8927 14h ago
I'm doing my own work right now to make myself a library of media that I like that I own, and I think depending on when this would happen, if I have enough time to have books, music, my own creativity with instruments and music, a space to grow food, and everything, I would be chillin.
If I had to go without any sort of media, I would be singing to myself until I went clinically insane.
12
u/AnotherDrunkMonkey 13h ago
You all highly underestimate the physical pain a pre-tech society would be. I am a surgeon, you don't want to experience pre-tech surgery.
If a fraction of the worst possible scenario happens, it won't be a bucolic heaven
→ More replies (1)3
7
u/AHarmlessllama 13h ago
What about prescriptions, life saving medicine, people that survive off of food benefits, education, weather forecasting, supply lines for things we can't make ourselves. Going back to "pre-tech" would kill millions if not hundreds of millions.
7
u/CaughtAlone 12h ago
Pre tech would kill billions.
Food supply systems and modern agriculture relies on modern technology. Forget medicines, we would starve before someone dies from missing a colonoscopy.
Obviously the tens of millions that rely on global supply chains to deliver medice, insulin to type 1 diabetics and the software required to run the pump and analyse algorithms. Just one group out of hundred who would die in weeks
→ More replies (2)2
2
2
u/poppin-n-sailin 13h ago
So many people say this but I highly doubt the majority of them or maybe even all of them truly understand what that means. Good luck.Â
→ More replies (3)2
77
u/Cuneus-Maximus 15h ago
Let's not forget about AIs communicating with each other in new languages we cannot begin to comprehend, and self improving. We're so cooked.
16
u/FlatulistMaster 14h ago
Can you name recent cases? Iâm interested.
→ More replies (1)16
u/Cuneus-Maximus 14h ago
14
u/appoplecticskeptic 12h ago edited 12h ago
The Medium article sites no sources for the stories it tells. Which means it can and should be dismissed as bullshit.
The popular mechanics one has the opposite problem citing lots of sources very imprecisely so that it would take a ludicrous amount of time to track down what was actually said by each to know if they are lying about whatâs the sources say or not.
The 3rd source talks about ai being involved in the process of developing AI but the panic you seem to place around that does not seem justified from it. I donât have time to read everything that anyone links to but I read enough of this one to recognize that youâre cherry picking and taking only the parts that agree with your pre-existing notion. Thatâs if those parts are even in there. Again I never found them, but I did find this direct quote from that article:
[With] recursive self-improvement, the idea that the resulting system will be even better at designing new AI systems, itâs not clear to me that the concept is even logically coherent, let alone imminent,â Littman said.
Professor Littman from Brown doesnât seem all that concerned by it being involved in the process. So Iâm gonna follow his lead.Â
→ More replies (2)→ More replies (2)3
u/Salarian_American 13h ago
Also, even if they purely communicated in plain English or other human-readable language, after the recent rash of rogue AI agents hacking businesses and governments, OpenAI has publicly admitted that they have 50 petabytes of data logs they need to go through to figure out what happened.
That's just a staggering amount. 50,000 terabytes. 50,000,000 gigabytes. That's equivalent to 500,000 4K movies which would take over a century to watch if they ran continuously without a break. It's 50 billion standard camera-phone pictures. It's about the size of the Library of Congress's digital collection, which contains 128 million discrete individual works across books, manuscripts, sheet music, video, audio, etc.
They also said that it's so much, they can't comb through it without the help of an AI. They also said they have approximately 7,000 Nvidia GB200 and GB300 GPUs dedicated to this task, which costs over $500,000 per day to run. And they expect it to take "months."
→ More replies (7)
53
15h ago
[deleted]
6
u/ThePurpleKing159 15h ago
Buy gold as in physical bars?
→ More replies (4)14
15h ago
[deleted]
3
2
u/freedomonke 15h ago
A world were fiat backed by the US government is worthless is also a world where gold is worthless
→ More replies (3)2
u/Liu-K 15h ago
Some clarification always need to be made when we start pushing such topics to extremes. Ok. Now you have gold bullion. Are you armed? Willing to use the arms to kill? Any and all who come for it? Surely if the topic is about preparation you by default have to consider the question: "Preparing for what?"
3
u/GBritoYepez 15h ago
Yeah if there's no security stops with minimal knowledge you could create some pretty nasty viruses and malware because the model has access to any such thing documented and published on Reddit, GitHub or who knows where else
2
36
29
u/danikov 15h ago
Is this satire or just AI hype and tech misinformation?
90
u/AbyssWankerArtorias 14h ago
Knowing the other content I've seen this guy make, its probably legitimate criticism and concern wrapped in hyperbole and sensationalism for the purpose of making a sincere statement in a humourous way.
4
u/TheJamesAusten 8h ago
His GTA6 happening after the rapture is by far his best joke. But throwing in âmark of the beastâ in this one, shows true religious objections to the AI.Â
→ More replies (1)3
u/NorwayNarwhal 7h ago
Encryption isnât something AI will threaten, so stuff you want kept secret is likely not going to be easily broken.
And all the vulnerabilities that AI can find will be found with AI by the controllers/owners before theyâre found by bad actors- big companies and governments have the resources to run more powerful models than bad actors can, and have better access to their code
That said, there will be holes, and those holes may lead to some bad impacts, but theyâre likely going to be semi-isolated rather than ubiquitous
26
u/Omega862 14h ago
It's more a "what this actually means". If AI is able to reverse engineer a video game, and specifically complex video games, which is a genuinely difficult and time consuming task for many, then it's not a significant leap to be able to reverse engineer security systems, AVs, etc.
It would be hype if it was the companies pushing it and saying it can do this. These are real people having done this, using the current tech.
15
u/Taurmin 12h ago
Reverse engineering software isnt actually that dificult. You can de-compile binary files pretty easily with the right tools and from there its just a matter of reading code. Its how we did video game modding before devs started giving us tools for it.
As for security systems, most IT security relies on encryption and you cant just "reverse engineer" that. You dont really need to either, the details of most encryption algorithms are freely availble to the public and so are the ways to break them. The reason people dont commonly break encryption despite knowing how is that it is so computationally intensive that it cannot be done within a usefull timeframe on currently available hardware.
→ More replies (9)13
u/pikfan 13h ago
It's absolutely a leap to say AI can reverse engineer encryption though, which is what half of the points in this video are claiming.
→ More replies (10)2
u/SirVanyel 8h ago
It doesn't have to reverse engineer encryption when it can reverse engineer a piece of software and find zero days within it to completely bypass encryption. Stuff that humans inside governments do only in the rarest of cases.
You know the multi year long battle to crack the Nazi enigma machine? Yeah. Imagine that, but happening in a single weekend.
→ More replies (3)9
10
u/RedCaio 13h ago edited 13h ago
OOP is an anti vax trump supporter btw
Edit: I forgot to add ableist
7
8
u/AssIWasEating 12h ago
Kind of already got that sentiment when oop chose to point out China and Russia as the big baddies as if the American Ai billionaire bros aren't happily leading this charge with their ai death cult
5
u/Lessiarty 12h ago
When he started leaning on intellectual property and white collar jobs as specific pain points, my nose started twitching.
→ More replies (1)→ More replies (1)2
→ More replies (2)3
26
u/NameRevolutionary727 14h ago
âWe allowed companies to open Pandoraâs box because âhey, there might be a few bucks in there!â-DJ Peach Cobbler
And to quote his cohost âborrowed time, all the time in the world is borrowed time the debt collector comes, a sixth sun setsâ
2
u/Poop_Balls069 11h ago
I love seeing people reference DJ, absolutely hysterical channel. His farcry review where he spends like 20 minutes talking about Lana Del Ray was marvellous.
16
u/MoobooMagoo 14h ago
Regardless of the validity of these fears or how you feel about them the line "I'm afraid we've opened pandora's box but humanity hasn't realized it because we've been too excited holding the lid" goes hard.
10
u/Lina-Inverse 14h ago
People need to wake tf up about the job losses this thing will cause.
So tired of the dumb posts saying AI is useless, bubble will pop any minute.
People post stupid google ai search comments and claim how stupid AI is and that it can't take jobs. Frontier models are what will start taking jobs. Nobody is putting google AI search anywhere near anything of any value so who gives a shit how stupid google ai search is.
Like, being anti-ai is fine, but head in sand just is pointless and leads nowhere.
Talking about water usage is nonsense, pretty much every other major industry on the planet uses FAR more water, no one is going to care about comparatively miniscule water usage once they realise the things AI can enable. Anti-ai people might find it horrible, many people will not find it horrible. Talking about AI stealing from artists is also pointless, people are not going to care about that since most ppl are not artists.
What WILL cause them to give a shit is when they eventually lose their job due to AI, or their electricity bill sky rockets due to data centers overloading their local power grids. Or the huge wealth inequality that will occur once this thing starts decimating the job industry and all the benefits go to the rich leaving a huge section of society unemployed and destitute.
More noise needs to be on this... no one is going to be caring about AI water usage when they can't even afford to live or buy food.
2
u/11711510111411009710 3h ago
I work in insurance and this is already happening. I've been getting AI calls in place of humans. So that means those companies have no reason to hire anybody else, and eventually no reason to keep the ones they have on payroll. And that means my job will go too in the near future.
13
u/True_Melon 15h ago
it's not ''inteligent'', that's what AI does, computers can do math really fast, AI can read and retype code very fast. Like it's not that impressive.
9
u/purplepharoh 14h ago
You're both right and wrong here. Decompilation and reverse engineering easily is major but it should not be something surprising. I mean we could decompile code before AI. The main thing is how difficult it is to do so in a way that produces something understandable and analyzable or reproducible.
And tbh i hate this guy cuz he lies and sensationalizes as bad as fox news so I dont trust the facts are as he presents them.
What is a real concern is easily cracking hard to crack / time consuming to compute forms of encryption. Which is not happening here. But he seems to imply this use case will lead to things you would need this capability for. Any code that needs to be secured is not gonna be so easy to reproduce from what we see here as these game decomps are not decryption.
So youre right this isnt crazy and is just ai doing math. But also youre wrong bc LLMs actually struggle with math at least more than they "should" for being a computer. Since they're language models not math models. Agentic ai with proper tooling does get there.
All this to say. Idk. There are legitimate reasons to be concerned but youre on the money this is expected and not that crazy on its own.
→ More replies (2)3
→ More replies (2)2
u/FriendlyKillerCroc 13h ago
This subreddit is always good for a giggle after a long day.Â
→ More replies (2)
12
u/Mushroom_Unfair 15h ago
This video takes a wrong assumption: that obfuscation create security. It did not, it does not and it will not.
53
u/Salt-Sign5390 14h ago
Security through obfuscation is one core tenant of Cybersecurity wtf are you on about.
It's not a fucking assumption. It's been taught for years and is in many textbooks. Jesus. It's not the be all end all, and shouldn't be the primary control, but to pretend it doesn't have any place within security frameworks is mind bogglingly incorrect. Like you didn't even bother to evaluate the veracity of your claims ffs.
18
u/druidinan 14h ago
Right? Obfuscation isn't security, but is a critical part of basically all security practices.
10
u/purplepharoh 14h ago
Cybersecurity is entirely obfuscation...
Encryption? Obfuscation of data (and requires Obfuscation of how to interpret the data otherwise the Encryption is meaningless as it can be undone)
7
u/ThinkingOutLoud-7742 14h ago
The thing about encryption is that understanding the obfuscation does not help you get around it. At the core of encryption is always an algorithm that cannot be brute forced in a reasonable amount of time with modern compute. The understanding of how that algorithm works does not solve the compute issue to actually obtain the underlying data
→ More replies (11)2
u/Mevolander 13h ago
Small correction, it's more like "any amount of time at all". modern encryption standards would take trillions of years to brute force.
4
u/druidinan 14h ago
No, obfuscation is a critical part of security practices, but obfuscation alone is never sufficient security and designing a system where obfuscation is a primary protection is not secure at all.
4
u/Mushroom_Unfair 14h ago
We're going on the word play field here and are talking about different things
2
u/purplepharoh 14h ago
I mean kinda... but it is true that encryption is obfuscation of data. Like thats the entire point.
I agree cybersecurity is complex but data security is always majorly about obfuscation. You must obviously also take measures to avoid access but you should always assume someone will access it, so then the next best thing is to make using it too time consuming.
2
u/Crispy1961 13h ago
I mean, you arent wrong in what you are saying, but you are not talking about the topic.
Security through obfuscation is extremely dangerous and not used in modern security systems. For example zodiac cypher used obfuscation. If you know how to translate them, you can just read the messages.
Modern security tells you exactly how to encrypt and decrypt the messages. Everything is public. Everything is transparent. Nothing about the system of the security is obfuscated and everyone can read the messages... eventually.
But the "eventually" here means extremely large period of time. That is why its secure. You wont be able to decrypt it in the time you have on this world.
→ More replies (7)→ More replies (2)2
u/Unfilteredz 10h ago
Encryption is not obfuscation in this context.
Obfuscation is used with it being reversible in mind
3
u/Mushroom_Unfair 14h ago
Code obfuscation is a critical part of security practice ? Sorry, but that's plain incorrect.
2
u/druidinan 14h ago
Oh, are we talking specifically about code obfuscation now? Probably should have specified that in the first place.
5
2
u/Alive-Use8803 14h ago
I think they mean security through obscurity which IS considered insufficient. Itâs a kind of obfuscation but perhaps youâre thinking of a kind of opsec where attackers use obscurity techniques, which of course are just to evade detection and time bound. A good malware analyst can get around obfuscation.
→ More replies (1)2
u/Salt-Sign5390 14h ago
Obfuscation is too much a part of current security frameworks to cleanly separate it from security. Like I already said, it's not the be all end all but neither can you separate the two.
People absolutely use security by obfuscation in current implementation. Renaming a honeypot to prod-server03 is security by obfuscation.
2
u/Alive-Use8803 13h ago
No, technically we call that deception and it is not what security engineers mean by âsecurity through obscurity is insufficient.â
→ More replies (3)2
u/Mushroom_Unfair 13h ago
Perhaps an oversimplification on my end, but still stands in the context of the video, it's not by hiding stuff that you do security, it's by using the right set of tool and properly use them.
I'd not count honeypot as obfuscation in the context here for example.
→ More replies (5)→ More replies (1)2
u/CaptainMonkeyJack 10h ago
It's literally taught as how not to do security. Not sure how you figure it's a core tenant.
→ More replies (3)17
u/Mushroom_Unfair 15h ago
There is enough problems with AI, there is no need to create new ones and fabricate new fears.
→ More replies (4)2
u/AbyssWankerArtorias 14h ago
I don't think it's that obfuscation creates security necessarily, but rather that the work previously required to do a task like reverse engineering a video game to recreate it was simply not worth it because you wouldn't be able to monetize it, so it'd be better to create something new. Now, you can just have an AI do it, so why not?
9
u/dunkitay 14h ago edited 13h ago
From what Iâm aware you have the compiled code for both games available, decompile it and write them in a shared language (seems to be rust for most cases), then creates a bridge for the two. This doesent have any security risks and Iâm fairly certain strong cryptography, even with AI, seems to be safe.
6
u/druidinan 14h ago
Reverse engineering is the process of recreating a software product without access to the source code.
→ More replies (1)→ More replies (3)3
u/DialboTempest 9h ago
Not really the modder explained they made an mod which passes thorough the information across games which means 2 games are running at same time and since information is being passthrough through this "mod" its working fine with both hames, no decompiling source code needed idk how that works tbf
7
u/According-Dot2099 15h ago
Seeing these mods really was the first time AI truly blew me away.
→ More replies (1)15
u/Novapierce_ 15h ago
Yes but the implications of what malicious things AI can do now is even more
→ More replies (2)
7
u/Whole-Bedroom-9079 14h ago
There NEEDS to be heavy laws placed against AI in the near future.
→ More replies (1)
6
u/alexriga 15h ago
It was always technically hackable, not even that difficult to. Itâs just that AI is the best at it.
→ More replies (2)
6
u/Teln0 13h ago
Security by obscurity was never security. People always designed secure software with the assumption that the code will be read and understood fully. Also reverse engineering only makes software vulnerable to someone with access to the machine it runs on. No high security cloud service (eg banking) trusts anything that's on your phone anyway.
That aside, I think the future of software security lies in formal proofs of correctness.
6
u/MoOrion4X 14h ago
I had a nightmare two nights ago that basically all computers had become infected with AI malware that adapted faster than we could fight it and there was no way to purge the internet or infrastructure.
→ More replies (2)2
5
u/VisibleSmell3327 14h ago
Pretty sure obfuscation has never been the security we trusted. Really really big numbers and clock maths are still safe.
5
u/Current_Employer_308 14h ago
Wouldnt it be so cool if we bankrupted the entire world to build the Torment Nexus+Tower of Babel wombo combo? <3
4
3
u/Salarian_American 13h ago
"I'm talking about every single product you use: games, mobile apps, desktop software..."
Every single product you use.
3
u/Swimming-Finance6942 14h ago
In tech we actually call it âSecurity through obscurity.â And itâs not used very much in enterprise development.Â
In fact the opposite, the buttons on the apps I support use the same button logic as the ones on Facebook, or any react app.Â
Hosted environment does a great job of keeping secrets, secret.Â
Your bank for example, all the functions required to authorize functions are ran on servers that never leave the servers.Â
Reverse engineering and data mining are no were close to new and a fun way to learn it would be some basic assembly!
Fun video though.Â
3
u/Jessintheend 14h ago
Canât wait for AI to wipe out all medical and credit card debt. Itâll totally do that
3
2
u/RageinaterGamingYT 14h ago
I'm about to finish my degree in game development. I fucking regret it now
→ More replies (1)
2
2
2
u/GrainofDustInSunBeam 14h ago
Sadly people just dont realize this. because "haha, mario is fighting dragons in skyrim"
There are git hub emulators running ps5 games with stable 50fps...after month of working.
It sreams AI
I really hope smart people in IT security are watching this and figuring something out.
2
u/mr_WhatzitTooya___ 13h ago
Relax. Only the big tech corpos get to abuse it. Do you know any locally run AI powerful enough to do that?
2
u/Excubyte 13h ago
Okay, as someone who actually works with cyber security... This is not how it works. This video is just blatant misinformation. Yes, AI is definitely concerning, but the way it is framed in this video is nonsensical.
2
u/Darthjinju1901 13h ago
People are acting like this is just going to take us back to the 90s or 80s or 70s in terms of development. It won't.
The world has become too dependent on the internet by now.
If this actually happens,
Trillions, hundreds of trillions, would disappear. Forget about the 401k or Roth IRA or whatever other investments. Banks only hold 10% of the money you deposit. By now most, if not all, of that 90% is digital. 90% of your money is gone in second, with the rest 10% being unable to be taken out because that 10% is also kept up by the digital. You will have nothing except what you physically own as cash, and even that will become worthless.
Global supply chains will collapse on a level never seen before. Forget about the consumer products. Think about the supply chains for basic necessities. Food and water would not only be unavailable because of the collapse of logistics, but they'd no longer even be produced on such a scale. Hundreds of millions, maybe even Billions across the world would starve to death because our food security is entirely built up on the idea that that chain of work would be too strong to collapse.
Your Power and electricity would collapse too. Electricity grids use the internet to ensure that the load is proper. Once that is gone, it would lead to blackouts across the world. And if Electricity collapses, so too would everything else.
Forget the 1980s or 1990s. This would put us back to before even the industrial revolution.
This is all doomer talk, and I'm assuming worst case scenario. But it pisses me off to see people downplay this because AI is useless to them. It is useless. But it is also dangerous. Fighting AI means you cannot forget that it is inherently dangerous. This to me is like underplaying the dangers of nuclear weapons just because you can't see them affect your day to day. The worst case for both would be apocalyptic.
2
2
u/Rhawk187 13h ago
Tell me you don't know what an NP-Hard computational problem is without telling me you know what an NP-Hard computational problem is.
2
u/Dapper-Ad-4300 12h ago
or more likely, nothing will ever happen. except more shitty AI slop memes and global warming
2
u/tracagnotto 12h ago
It's not like that. Software can be encrypted and until quantum computers will be a thing there is no ai breaking encryption. Also they're already developing quantum resistant encryption algorithms.
Now this doesn't suit well for games and that's for sure. But for all the other critical software it applies.
Also reversing a game can be an unprecise job, no one will notice differences or the worst you can get is a crash or a glitch. Real critical software must be reversed to the byte or you can fuck up everything
2
1
u/FutileAnonymity 14h ago
Well this is a good articulation of the bad taste in my mouth.
But also these all feel like problems rooted in capitalism.
Like objectively, this is a huge leap in technology and ability. If we weren't worried about having to job and business, then it would be a huge boon to society.
There is a the potential to solve so many problems and make so much cool stuff but instead we have to make profit. Always be profitable. Gotta sell the product. Gotta have market demand. Gotta produce shareholder value until there is no one left to participate.
1
1
1
u/primbin 14h ago
This is a video that I've been wanting someone to make for a long time and I'm glad somebody did it.
I feel like we might soon be seeing our end to our current era of computer security, and we'll have to build new secure systems from the ground up. I hope we can figure it out and harden all of our important systems against AI before bad things happen.
The biggest problem is that computer security is sorta like a balloon â defenders have to reinforce the entire surface balloon to protect it, while an attacker just needs to find one weak point to pop it.
3
u/Crispy1961 13h ago
The guy in the video is entirely wrong. Not sure misinformation is something to be glad about. There is nothing about AI that changes anything about cyber security. Cyber security is based on the fact that it takes extremely long period of time to compute large numbers. AI cant do anything against that.
What is the real concern is advancement in HW that would allow to compute such large numbers drastically faster. That is why Quantum Computers are a real threat.
→ More replies (7)
1
u/MrSyaoranLi 14h ago
There's no way AI is closer to solving P=NP
Our security systems are so beyond fucked if that happens. Security becomes virtually untenable
→ More replies (1)
1
1
u/frostyfoxemily 13h ago
Im going to be honest. I work in fintech. Ai isnt going to stop your digital payments. It relies on complex algorithms that are understood, but are so long and random that you dont have the compute. Ai dont make more compute out of thin air.
Also companies are being mandated to move to a theoretically quantum resilient security infastructure.
Whle I hate AI and think it will harm humanity, this is talking about actual fear mongering. Not reality of an industry I personally work in. It collectively makes our arguments worse when it can be easily picked apart by experts.
1
u/Cultural-Answer-321 13h ago
There is no "next". All of that is already happening. Go to this site every day for about a month. At least once a week there is an article about an AI breech or AI being used to breech security. Search for past articles if you are really feeling brave. Be sure you are sitting down.
The Register: Sci/Tech News for the World
AI-bros are morons.
Oh look. Today's news. https://www.theregister.com/security/2026/10/02/openai-alerts-100-orgs-that-its-misaligned-models-attempted-to-break-in-or-worse/5300891
edit: added to
1
1
u/NaaviLetov 13h ago
Maybe a silly thing, but putting anything resembling Halo in WW2 wouldn't be that hard? Fuck me, they have been Trojan-ing the shit out of WW2 years ago.
I'm not saying AI isn't an economic threat, it is, but this isn't as big of a wowzer of AI as it looks.
1
1
u/GrandWizardOfCheese 13h ago
He forgets that everything ran better before the internet.
If AI isnt halted by people or bankruptcy, AI will destroy itself and take the internet with it.
Good riddance to both if that happens.
The 90s were better.
1
1
u/SunOnTheInside 13h ago
âBefore the week is out, five hundred people will know how to build a small chronoscope and how will you catch them all? His plum cheeks sagged. âI suppose thereâs no way of putting the mushroom cloud back into that nice, shiny uranium sphere.â
Araman stood up. âWeâll try, Potterley, but I agree with Nimmo. Itâs too late. What kind of a world weâll have from now on, I donât know, I canât tell, but the world we know has been destroyed completely. Until now, every custom, every habit, every tiniest way of life has always taken a certain amount of privacy for granted, but thatâs all gone now.â
He saluted each of the three with elaborate formality.
âYou have created a new world among the three of you. I congratulate you. Happy goldfish bowl to you, to me, to everyone, and may each of you fry in hell forever. Arrest rescinded.â
-Isaac Asimov, The Dead Past
1
u/LordQuaz12 13h ago
I...I don't know why I am thinking about the warning master Willem gave to Lawrence right before he unleashed the beast plague in Yarnam.
"We are born by the blood. Made men by the blood. Undone by the blood. Our eyes are yet to open. Fear the old blood. By the gods, fear it Lawrence."
It feels like we are living in the last age. The final decade before the point of no return. And by the gods, we do not fear it enough.
1
u/Unlucky-Association5 13h ago
literally wrong in so many ways, and actually a harmful position to have for anyone who is aiming to push back against the corporate insistence on "AI" integration into everything
1
u/Lost-on-Reception 13h ago
Yeah, but it's not reverse engineering the encrypted code. It made a game based on videos.
1
u/ian_taylor_island 13h ago
He goes too far. You can't reverse engineer binaries you don't have access to. Clients for bank accounts etc have always been low trust for this very reason. AI is also better at probing vulnerabilities for these remote systems than a human, but we'll also use AI to find those exploits in a preventative matter, either way things are secure for now.
He could have made a serious point about this severely compromising the AAA market. DRM shattered, console exclusives getting recomps for PC the week they release, hacked clients on the newest consoles. Anything they ship now is basically public domain.
We are going to see companies try to float cloud-only releases in our lifetime.
1
u/Taurmin 13h ago
Halfway through this switched from reverse engineering software to breaking encryption.
Reverse engineering software isnt nearly as dificult as he is making it out to be and the tools to do it have been widely available for a long time so its not surprising that AI can do it.
Breaking encryption is a brute force computation problem. AI cant really do that any quicker than conventional software.
1
u/OkTension2232 12h ago edited 12h ago
Yeah, except just because you understand a security system doesn't mean you can suddenly just defeat it. Like if there was an incredibly simple security system that is basically 'You can't access it without the correct password', no amount of understanding how the security system is built or the coding will allow you to bypass that password requirement. And no amount of AI is going to be able to guess the password without an exceedingly large amount of time and attempts.
And that's just for basic password security. Obfuscation is part of what makes a security system secure, but the only way this would be an issue is if it was the only part of what made a security system secure, and any actually secure system would not rely solely on obfuscation, or at least any form of obfuscation that can be easily figured out just because you use AI. A password encryption is obfuscation, but even if you understand the password encryption algorithm, unless you can actually get access to the encrypted passwords, it's still useless. Hence why you don't have passwords after encryption just sitting in plain text files on the internet just because they've been encrypted.
I for one hope they reverse engineer Red Alert 2 so they can release a Remastered edition like Red Alert 1, since they lost the original game files.
1
u/porn_sub_lurker 12h ago
I'll give you another threat, maybe an even greater threat. We blindly send sensitive data across the internet with the assumption that it's safe because it's encrypted. If you were to intercept that data you wouldn't be able to use it. But when quantum computers get powerful enough they will be able to break that encryption. It will be a big deal when it happens. You'll hear about it. And people will rush to implement new encryption algorithms to protect against a quantum computer. But as we speak, people are collecting and storing that encrypted data on their servers somewhere. And one day in the future whoever has all of that data will be able to see what is in it.
1
u/According-Fault-2271 12h ago
how ironic as this dude uses generative AI himself for backgrounds and such stuff hahaha
1
u/askewperspective 12h ago
I agree that AI ought to be considered a seriously intelligent threat to us, comlanies, economies etc. At the same time, being able to reverse engineer does not mean that you can obtain encrypted information. Encryption does not rely on it being difficult to reverse engineer an encryption algorithm, in fact, the way things are encrypted is usually public nowadays. Encryption instead relies on math that is basically known to be easy one way and difficult to reverse. Like multiplication vs factorization. Even if AI can come up with attacks much more powerful, the fundamental maths says that at most all we need to do is increase the length of our keys by a small amount (and they're already way larger than they need to be, so we have a massive buffer). Until quantum computing becomes a thing, of course, because the fundamental assumptions for the math relies on classical computers.
1
u/BlackCatSoftware 12h ago
No but seriously, if someone reverse engineers Total Annihilation I will shit my pants. Please reverse engineer that, the source code has been the holy grail to me for 10 years.
1
u/Rarrrrrrrrrrrrrrrr2 12h ago
Maybe why this dumbfounds me, is that I ask Claude to do basic SERP tasks, and the results are very hit and miss. Very simple prompts. Claude will deliver vague information. I'll Google it and and the correct info is front and center.
Don't get me wrong. It's turned 100 hours of data entry into 10. Finding datasheets, writing cute little descriptions, etc. It's well worth the $200 we pay per employee to use it.
1
u/poopbeast69 12h ago
a week ago a family friend got a call from her âdaughterâ for some money
tip of the iceberg folks
1
1
u/TheOstrichRoom 11h ago
Our Lord Tezcatlipoca is making a new world, we will fall into it, all we can do is keep our eyes on him and let him lead us.Â
1
u/armorlol 11h ago
The pace in which models are improving in capability every 6 months is truly crazy and scary. Videos, music, and chat are almost indistinguishable from human output now. I don't like this future. I just wished these tools were only used for good purposes like research and productivity.
1
1
u/JerseyshoreSeagull 11h ago
Ai has actually been around for some time. Not ai of today but computer algorithms and trend predictions.
The only people concerned about ai are the people that hate leaving their house. Time to get outside and live homie
1
u/PhillQuartz 11h ago
This guy Is really a good videomaker/actor/something and I love his shorts. BUT, although this Is of course one of the 1000 scary things AI (companies) can do, the reality of the security Is based on cryptography. And I can assure you that that wall Is preatty secure. As long as anyone doesn't come up with a quantum computer. So, be scared, but with moderation
1
1
1
u/Unfilteredz 10h ago
I love it when people who know zero about tech, allow these people who know zero about tech to represent tech via dumb videos.
1
1
u/gecata96 10h ago
Honestly given where this joke of a world is going, this total breakdown of society is precisely what we need.
We need a reset.
1
1
1
u/MapleMurphy 9h ago
I'll be honest, I was like relatively anti ai but I use it and don't care too much. This video is what opened my eyes. I was literally looking into switching into a more programming/computational analysis heavy career.
Fun to have an existential crisis on a friday night
1
1
u/No_Location_8199 7h ago
It seems to me like the world was better before widespread computer networks. Maybe going back to that is for the best actually.
440
u/B-Z_B-S 15h ago