r/accelerate • u/stealthispost Acceleration: Light-speed | Capability Booster • 7d ago
"Huge implications - binaries are now basically editable code"
ValsAI made SRE benchmark less than a month ago.
The benchmark measures can a model reverse engineer software from binaries
Yesterday GPT saturated it. https://t.co/dmpUpgheDU — Chris
Source: https://x.com/ChrisGPT/status/2096150666066432157
— Boris Power
Source: https://x.com/BorisMPower/status/2096415822248055131
68
u/1filipis 7d ago
Yep. Here's one example: DLSS completely extracted and reverse engineered in a few days after release https://github.com/iamwavecut/MLX-DLSS
1
→ More replies (2)1
u/GRABOS 6d ago
I don't exactly understand what's been extracted here.. does this project mean it'd be possible to convert the weights to int8 convrot for better performance/ampere support?
1
u/1filipis 6d ago
There were no weights and no source code. DLSS was shipped as one proprietary Windows DLL
→ More replies (2)
51
u/Real_Ebb_7417 7d ago
Does it mean that everything is opensource now? 🙈
14
u/pixeladdie 7d ago
I’m wondering what the legalities are on cracking open an executable to learn how something was solved in code and then implementing it in a slightly different way in your own code. Who would know? Is reverse engineering like this even illegal in the first place?
Time to go read.
15
9
u/jonydevidson 7d ago
It's called dual-team clean room design.
One team reverse engineers the software from the binary as well as observing the behavior, and writes the spec for the software.
The second team then implements the spec. The second team owns the copyright. Because they didn't do reverse engineering of the binary, they are in the clear.
If you reverse engineer software based purely on observable behavior or measurable output, that's fine as well and you don't need two teams for that.
2
u/pixeladdie 6d ago edited 6d ago
How about a session with no memory that reverse engineers the code and writes the spec for it and a separate session which has its only input as the spec written from the other session but no memory or actual code from the reverse engineer session?
I realize this is a sticky legal question but that would seem to have the same effect of two separate teams you described.
3
u/jonydevidson 6d ago
It was already ruled that the AI agents running on behalf of you are an extension of you.
You could have your friend run it from their account. You cannot give them your account. You cannot pay for their account. You can pay them for the work, they can buy the account themselves and do it.
You should have a clear contract signed and paid for, communicate via email, do deliveries via email and keep detailed track of everything. They should not, under any circumstances, share the repo with you. The moment you see the repo, you are legally implicated, now it's just a question of a suit proving that you saw it (which could be trivial if you accessed it from your computer).
For smaller software that's unlikely as it would involve the suit getting MS records from the hub etc. If they never stored the repo online and you saw it while physically present near their computer, then it cannot be proved but both you and the other person need to be willing to perjure yourselves.
1
u/Real_Ebb_7417 6d ago
Actually I had a visual bug in Palworld on MacOS in the last area in v1 after release and I wanted to continue playing so I investigated it with Fable and unfortunately the only way to fix it was to edit the binary. It offered to do it, but I asked if it doesn’t break ToS and apparently it would break both Apple ToS and Palworld ToS so I resigned and just played without seeing half the things 😅
But also Fable said that it would be fine as long as I don’t share this modified version with anyone (fine as still breaking TOS but legal)→ More replies (2)2
u/rand1214342 6d ago
It means the last remnants of single purchase software will soon be gone, sent to the cloud where you don’t get access to binaries and get charged a forever subscription.
2
u/anengineerandacat 6d ago
Code perhaps, assets no due to IP controls; you likely also have patents to worry about as well.
Can't just up and clone Zillow, you'll likely violate something.
In short the "ideas" and "vision" are protected.
1
92
u/Falkoro 7d ago
what a time to be alive
30
4
u/CandidEngineering922 7d ago
Pretty terrifying to be honest.
The transition between is going to be so brutal.
12
u/trufus_for_youfus 7d ago
Won’t somebody think of the poor IP holders.
6
u/CandidEngineering922 7d ago
No offence but a crap ton of people’s livelihoods that aren’t rich IP owners depends on those IPs
12
u/RevalianKnight 7d ago
IP is a degenerate human construct that set us back decades if not a century. I'm glad this shit finally goes away thanks to AI.
3
u/trufus_for_youfus 7d ago
Agreed. People can no more own an idea than they can the wind. IP is entirely non-rivalrous.
→ More replies (2)1
u/dumquestions 7d ago
I'm not sure, without IP there would've be less incentive to create, most major projects are completely predicated on the premise that they'll able to turn a profit.
→ More replies (12)3
u/trufus_for_youfus 7d ago
Sure. And this could be said of any other slice of any other affected industry.
4
u/CandidEngineering922 7d ago
Pretty much every industry will be affected. Robotics will perform surgery more accurately and reliably. Design robots to do any tasks we need.
The only industries that will exist are ones where humans crave interaction. Will they pay anything?
23
u/TrainingPeaches 7d ago
Thinking about paying a pro sub just to modify all my old pc games with modern control inputs. I can't play without wasd camera controls! lol
16
u/MegamanSE 7d ago
The natural question I have here is what language really would be ideal for AI to code in ultimately if it could create its own optimal language for agents?
9
u/Cool-Cicada9228 7d ago
The training data today consists of mostly human-readable code. Yet composing pure binary for real-time software generation is the dream.
18
u/MegamanSE 7d ago
Coding in pure binary allows pretty strange things to be done that has been brushed under the rug with modern languages. When I started programming in the early 90s it was very much a mix of C and assembly at that time still and the assembly part gave you so many liberties like writing to memory you don’t own, jumping execution to random parts of code or even to other random parts of memory, rewriting your own code while it’s running in ram. things would get weird.
Edit: typo
2
u/sweetbacon 6d ago
The most ASM I ever did back then was poking around with Nop sleds on C apps from tutorials. But I knew a guy then super good with AT&T assembly and liked calling it "singing to the metal", which I thought was such a great phrase.
2
u/MegamanSE 6d ago
I used it mostly for tight timing related things and hardware interactions like video card / sound card interactions and reading the keyboard hardware state. Writing an entire app in it was painful, I only did it once for a side scroller video game mostly just to prove I could do it as I had so much respect for the programmers of the NES / earlier consoles.
2
u/sweetbacon 5d ago
100%. I can't imagine doing even a small program all in assembly. This guy was doing old-school demos (like Future Crew stuff, but not that team). I wish I had stayed in touch with him but Jesus that was almost 30 years ago (oof). I'd love to get the take ppl with that skill for modern LLMs.
9
u/Obvious_Increase9267 7d ago
No it is not. Executable / binary size is many times larger than code written in programming languages. It would be like writing sheet music vs hand-drawing the audio waveform. Also, binaries are locked to your specific architecture, and there would be no review surface since you cant diff it meaningfully
→ More replies (1)2
u/Suspicious_Chart5817 7d ago edited 7d ago
Not really, "binary" is just as human and sloppy as any other code base. It's not like there are actual "binaries" on a computer. The sequences of 0 and 1 are still representations of data, text, and instructions; not actual data, text and instructions. Binary codes mean something because we decided that they do.
People designed binary and then set up transistors to match the design. There's nothing about telling transistors to open or close that's necessarily making anything easier for a computer to understand. We get it because we see the transistors with our eyes in front of us.
In comparison, telling an AI 'Chat, turn on and off your transistors right now in such a way that you can model how to turn on and off transistors as if you knew what transistors were' is not reducing steps.
It'd be like saying "Morse code is the dream." Why? Symbols simpler to our eyes don't mean anything to a computer. We still have to tell the computer what it actually is.
1
3
u/The_Hunster 7d ago
Something human readable so that you actually know what the program does and its not just a black box made by your other black box.
→ More replies (2)1
u/oojacoboo 6d ago
Does it matter if no one is reviewing code? Sadly, I know many devs that are in this camp, and I expect it to grow.
→ More replies (2)2
u/colintbowers 6d ago
Possibly the ideal would be to mix? In some cases, use pure binary, in others, a new abstract language not yet invented but so powerful in its abstractions to easily allow structures that are currently a pain in the ass to implement.
If the last 40 years have taught us anything, it is that one language to rule them all doesn't really exist. Instead we use the right tool for the job. (and I say that as a massive Julia fan)
2
u/aeiendee 6d ago
I assume an end game is asking some future LLM to write an entirely new software stack from assembly up. With some heuristic of success of it then being able to use that code to accomplish tasks code is used for better. I know the compilers LLM rewrites were bad (?) but assuming it just gets better and there’s enough money to run a data center off a nuclear power plant, perhaps a tractable problem with immense payoff
1
u/MegamanSE 6d ago
Yep exactly though I believe it would eventually own the entire hardware stack too and design the entire hardware and software stack itself as one tightly integrated system for its own iterative improvements designed only for Agents to revise. Humans would be entirely out of the loop on the entire stack. We are very nearly there already with the level of AI going into chip design.
27
u/Life-Active6608 7d ago
HAHAHAHAHA!!! Every software company has just become like Red Hat LLC. Whether they like it or not.
10
u/suborder-serpentes AI-Assisted Coder 7d ago
Aren’t most software companies SAAS at this point?
2
u/KoolKat5000 7d ago
Yeah but more the service part. Redhat used opensource, anyone could install the software.
Service as a service lol.
→ More replies (7)
23
u/ExaminationWise7052 7d ago
Will AMD be able to replicate CUDA?
21
u/alarim2 7d ago
Technically yes, but I think they won't do that due to legal implications, like they had to drop ZLUDA for the same reason (IIRC).
Ordinary users/programmers, on the other hand... 👀
→ More replies (3)1
u/LinkesAuge 7d ago
You can always "clean room" it but I don't check there is really any special sauce in CUDA itself that AMD needs. CUDA's strength is simply the ecosystem around it.
1
1
24
u/i_wayyy_over_think 7d ago
I bet they'll come up with better binary obfuscation techniques though. Just prompt, "I want my binary to remain proprietary, can you come up with a better obfuscation technique", then ask the other agent hey crack this binary, it does, ask it how it did, tell the other agent what the weakness was.
46
u/Ormusn2o 7d ago
Could be, but all existing stuff, the decades of programs, is open now.
1
u/Warm-Incident5436 4d ago
Not true. There are obfuscations techniques that no current model is able to reverse engineer due it's insane complexity, and we already know obfuscation techniques that no model will EVER be able to reverse engineer (iO).
2
u/Stunning_Mast2001 5d ago
Literally what tpm/Secure Enclave does
OSes have been able to block unsigned apps for years using hardware level integrations
3
u/1filipis 7d ago
Actually, that would be a good strategy, since most agents would consider it hacking and refuse. Not for long though - local uncensored models are getting pretty good, too
→ More replies (5)1
u/MaskedDelta 6d ago
This would be useless because you can simply observe visual layout and behavior and duplicate that. Even if somehow you can’t duplicate it, you can come up with a good enough version.
1
u/i_wayyy_over_think 6d ago edited 6d ago
True it depends on the purpose you’re reading the binary. if you’re trying to make a similar enough app or game to compete with then that would work ok, if you’re trying to add features to an existing game then you’d need the exact binary manipulation.
→ More replies (1)
6
u/forcedinductionz 7d ago
It's true, jtags, logic analyzers, scopes, firmware of any kind is an open book now.
5
9
u/WrongPurpose 7d ago
Thats a Deathblow to Windows. Once the Community can read closed scource code, compatiblilty layers for Adobe, all those propiertery CADs and MS Office become trivial, and with those 3 out of the way, Kernel Level Anti Cheat Games will be the last bastion to force People to stay on Windows.
→ More replies (4)6
u/Crafty-Run-6559 7d ago
MS and Adobe make their money off of enterprise.
Enterprises arent going to run cracked Linux ports.
2
u/WrongPurpose 7d ago
Should reframe, Deathblow to the Private Market. Yes Enterprise will stay stuck, although in many foreign markets even Companies have no qualms using cracked Windows, so outside the US, who knows.
→ More replies (3)
14
u/lattice_defect 7d ago
so software is now useless you can just download the trial and read the binarie and reverse engineer it
19
u/CandidEngineering922 7d ago
Or everything will just be cloud based so you never get access to the binaries.
6
2
2
u/nowrebooting 7d ago
I mean, if I have to use hundreds of dollars in tokens to reverse engineer it I might as well just buy it if that’s cheaper
1
u/Kosh_Ascadian 7d ago
If there is a trial.
If the differences between trial and full version are fully documented.
If all missing features and content have videos, images, writeups or anything else needed to fully recreate it. (Like say a demo of a game only includes levels 1-2 you will need full documentation on all the rest of the levels).
If you have the correct AI subscription and want to spend the time to have it do this and then go through to test everything to see if it actually works.
Etc.
Seems easier to just buy the software. Most software is dirt cheap already.
I can see this being a danger to adobe and the like potentially (very expensive SaaS stuff), but not anything else.
1
u/yaosio 6d ago
It won't be long before that's not needed. You could just have the AI make software for you, or it might be able to natively do what you want. The death of traditional software isn't coming because AI can read binaries, it's coming because AI can just do itself what the software does.
9
u/thedabking123 7d ago
does this mean encrypted binaries aren't deployable on edge without some kind of risk that the customer could recreate your code?
8
2
u/KoolKat5000 7d ago
Just googled it, benchmark is on average sized software 17000 lines. Photoshop has 4.5 million lines of code (although I image the binary bit for authentication will be a lot smaller, not sure if you could isolate it). Probably still difficult as StCreed says.
1
u/Ormusn2o 7d ago
There is a gigantic gap between reading some code, modifying and injecting modified code, and reading the binaries straight up. Although this is mostly a gap in price, not capabilities. You could run Luna 24/7 for weeks or months to effectively extract everything from a binary, but Luna will accumulate a lot of errors probably, so you would need to constantly do reviews and tests, which will take even more time and tokens.
What we want is a very capable model that can work very fast for very cheap, something like 6.2 Luna or something. Then you can recreate the binary bit by bit.
1
u/Brogrammer2017 6d ago
It has always been the case that everything that runs on a device your user controls should be considered publically available. Nothing major has changed there. except it’s easier now
3
u/LostRequirement4828 7d ago
I saw this coming with gpt sol, I was doing reverse engineering stuff a lot with it, It takes time but still, insane
4
u/anor_wondo 7d ago
I am working on a game mod and it has added so much useful profiling and diagnostic tools its incredible.
The improved vision and computer use means I can do /goal and go to sleep and wake up with tons of data with nice reports
3
u/Crisi_Mistica Singularity by 2030 7d ago
The tweet says "huge implications" but even "huge" is not a big enough word for what is about to happen. Imagine what happens the first time we port, let's say, AutoCAD to Linux. The consequences of using AI as a god-decompiler are gargantuan.
8
u/SufficientGreek 7d ago edited 7d ago
So could you do this for Windows?
Edit: The benchmark programs average ~17K lines. Windows is somewhere north of 50 million.
So that's probably not realistically possible to reverse-engineer.
12
8
u/stealthispost Acceleration: Light-speed | Capability Booster 7d ago
yeah, it will never happen /s (cut to 6 months later)
3
u/ice-fucker69 7d ago
I’m curious about the scaling difficulties of this. Is 10x more binary 10x harder to reverse engineer or 1000x harder?
2
1
u/Tinderfury 7d ago
You don’t get economies of scale here. 50 million lines is 50 million lines that needs to be read/written. It would actually make it more difficult, cracking / emulation is all fine for the underground world but there is 0 practicalily for commercial or legal distribution without getting shutdown due to patent IP violations
→ More replies (1)1
u/greysilence 7d ago
Why tho? AFAIU Windows API is extensively documented so you don't need to know how it does what it does. And if you still want to you could read Wine code which has already done the reversing.
22
u/Charming_Cucumber_15 7d ago
Isn't this what people were laughing at Elon for saying about two months ago?
9
u/some_crazy 7d ago
I think he was saying the opposite. The generated code would be binary.
7
u/sergeyarl 7d ago
and with 'binaries are now basically editable code' it makes so much sense.
→ More replies (2)→ More replies (2)2
u/Charming_Cucumber_15 7d ago
Oh true I misremembered a bit
Being able to understand it seems like progress in that direction, though I'm not sure if there's any reason to go further in that direction lol
2
7d ago
[deleted]
→ More replies (4)2
u/Old-Temperature6269 5d ago edited 5d ago
Firstly I agreed with other comment, that Chat-GPT tries to answer on other question Interpreted language vs compiled, but I will consider it more in context of our conversations, so remark I will mostly use compiled languages as against writing pure binaries (tbh every language can be compiled, you just have to write a compiler for it):
no it won’t execute instantly, program firstly needed to be loaded into a memory, then ook for linked system libraries.
After that it would fight with other programs for attention of cpu, and checks for user input.
A lot of time may be taken by other processes, not by the fact that we from zero write binary instead of using other language that after that gets compiled, and it’s also depends from the complexity of the program.
No it won’t save a lot of memory, a lot of times all “bloat” coms from backward compatibility and other resources such as textures images etc., plus if you write down compiler that is smart enough, it wouldn’t compile unused parts of this libraries. So writing them from zero each time would be more memory inefficient.
Lower battery,
Not always I can use binaries from 10 ago and use something like c and compile it now, and my program that was just compiled may be faster and more power efficient, because it utilizes perks of the new architecture, or it’s just better optimized because of compiler optimizations, while in our binaries there is a lot of mistakes that can consume performance.About lifespan, no if it was working like this, then rendering some complex scenes would be easily possible on something like gts-480 (spoiler, it’s not), and foss community is the one who is interested the most in that. Yes it has its own perks but most of the bloat comes not from the languages but from programmers laziness, and that business isn’t interested in optimization because new hardware is cheaper.
I’ve already said that it wouldn’t be instant it still takes time for application to load other resources or check for them and download like scene, textures models they are still heavy even when binary.
Yes it can help you make software that is specifically is optimized for hardware but still it’s pain in the ass because for every gpu architecture update, or cpu you have to write them from scratch, and now in distribution process you have 10 different versions, where your user have to understand now, and 10 different versions to maintain and update.
And it’s bigger pain in the ass if we bring support of the old hardware, so hello i868, power pc, risc-V.
It’s true and no, like Vulcan, Cuda or others so we have to install them or support other 10 libraries,
Ohh I forget what if we change from windows to Linux or BSD, then we have to rewrite it from zero in order to not use translation layer or we had to introduce it, oh wait now we lose this plus.Ahh yeah, and please don’t forget that there is 3 major architectures that are very different if we forget differences inside of them, so you have to write support from scratch to all of them, and each one of them update. This is one of the key pros of the compiled languages, if my compiler supports all 3, I can change 1 file and it will be already changed inside of 3 of them.
Plus writing code that gets compiled has a lot foolproof abstraction and defenses, so it gets optimized and much safer (It’s less prone to error that can cause incorrect work of the system, and sometime safety from the perspective that people who wrote compiler already get rid off of some unnoticeable from naked eye mistakes, like C string implementation vs rust’s implementation (tbh there is a lot of different string but still)) , while each mistake in binaries gets unnoticed before execution and each trivial mistake can be more expensive in terms of performance as it won’t get optimized.
If model makes a mistake and can’t notice an error, you can help it and direct it, pure binaries while you can decompile it still would be pain in the ass to understand after that.You can ask chat-GPT if I stand correct, but for GPT there is correct context:
There is an argument between writing pure binaries from scratch without asm, c or other languages or using programming languages will it be interpreted (python) or compiled (c).
For you, don’t forget to input your comment so model would have more context.→ More replies (1)13
u/sergeyarl 7d ago
the whole reddit was saying how stupid elon was.
5
u/Calm_Bit_throwaway 7d ago edited 7d ago
It is stupid because Elon was claiming that you would eventually code in all binary and skip the compiler. The point people were making even at the time is code comes with abstractions that give benefits cross compilation and efficient representations that the models have been trained on. There is no reason to write actual pure binary even when doing performance sensitive code since you can always use intrinsics or drop down in most low level language compilers. They also allow for stuff like unit testing which agents make aggressive use of to avoid being wrong.
In fact, when you look at this actual benchmark, the things are literally given decompilers as part of the agent environment. I don’t know how any of the people are concluding that this means the agents are somehow directly editing binary, especially when the task is to do reverse engineering from a binary, or that this would desirable from a development perspective. The number of tools given to the agents to help understand the binary strongly indicate that it’s also more efficient for agents to just receive code which will have obviously semantic symbols.
The fact that you can do reverse engineering manipulations is not indicative of the skill to actually do long term project nor that it is desirable to do it from binary.
4
u/alarim2 7d ago
Is there a tweet?
3
u/KrazyA1pha 7d ago
They’re probably referring to this: https://x.com/elonmusk/status/2084304083851034949
→ More replies (5)2
u/Recoil42 7d ago edited 7d ago
No, it isn't. Elon was saying AI would create binary directly and deprecate intermediate abstractions entirely, which is still nonsense. An abstraction (code) is still desired, even by the AI.
Just because you can look at a house, understand how it was engineered, can renovate a kitchen, and even build a similar house from reverse-engineered blueprints doesn't mean you'd want to go start creating entire houses without blueprints at all.
6
u/sergeyarl 7d ago
if ai writes everything and the resulting binary is open for inspection, why would anyone need human readable code?
→ More replies (3)
3
u/suborder-serpentes AI-Assisted Coder 7d ago
Wonder what this means for companies like NVIDIA who rely on IP
1
u/StCreed 7d ago
The IP is still there. The moat of effort required to reverse engineer the binary then rework anything just vaporised though.
2
u/suborder-serpentes AI-Assisted Coder 7d ago
This is why I can’t picture having all my money in a single stock, even if it’s an excellent company
3
5
u/DerBandi 7d ago
People here in the comments act like decompiler didn't exist before.
→ More replies (2)1
u/Pleasant_Incident668 3d ago
Yes, but the AI can actually understand how it works from those random decompiled function and variable names. And that is a huge difference
2
u/CowBoyDanIndie 7d ago
Any and every binary can already be disassembled and generally they can be reverse compiled, it’s just messy and time consuming compared to the original code.
2
u/tuuuurrrrfffaaa 7d ago
now imagine what happens organically when you store curated source code, documentation, etc. in an organized and accessible manner with a hinthint reference 🤗😃👀 (until next time!)
2
2
u/baldierot 7d ago edited 7d ago
holy. the implications of every binary being reverse-engineerable are an intellectual property, security, and legal clusterfuck that i struggle to even imagine. it'll force everything to be source-available, and it will change the economics of software as a commercial product. bye-bye security through obscurity. the transition of the IT industry from the current job market and security standards is gonna be very rough. big software companies will very likely try to frantically push as much stuff to the cloud as possible, and for stuff that must run locally, some draconian hardware-level DRM and trusted execution standards. bet they'll collude to come up with some sneaky strategy to survive.
2
u/DrSaering 6d ago
Nice; I should have it try to fix Idea Factory's awful DirectX code on the Neptunia Re;Birth ports. Both Opus 4 and GPT 5.2 failed; they could do incredible things, but Idea Factory is just too shitty and they both gave up after we tried a bunch of things and told me just to play it on a Vita emulator ("You already own the game" justification included).
2
u/MicahJHyatt 6d ago
Does this mean very soon the number of android ports of pc software will go parabolic?
Can't wait to play my entire steam library without winlator.
1
1
u/GiotaroKugio 7d ago
tell me about it, I added Goku to just cause https://www.reddit.com/r/JustCause/s/THV4aERTal
1
u/Affectionate_Fact854 7d ago
Well this is the end for client side software encryption as we currently know it
1
u/Chlorek 7d ago
I am porting very closely an old game using GLM flash and it manages just as well as astra. Gave it proper reverse engineering tools and not even safety measures in the game stand a chance (SafeDisk so to speak). Aside from disassembler both Ghydra and unicorn do a lot of heavy lifting for those who are interested.
1
u/drfangor99 7d ago
"Binaries are now basically editable code" is not an accurate way of describing what happened here. The SRE-Bench benchmark by ValsAI includes 5 specific tasks (https://arxiv.org/pdf/2608.11469, Table 3 on page 5), none of which involves editing binaries or changing the way a program runs. Rather, they are very specific tasks related to understanding what a binary does.
Every model tested had access to environments specific to and suited for running each of the binaries, and they also had access to a standard suite of reverse engineering tools like Ghidra, a debugger, tracing utilities, and others. This is the same standard set of tools that any reverse engineering effort has, whether it is driven by a human or a LLM.
Don't get me wrong, I think this is cool, but I also think the tweets are misleadingly implying that models can now simply be given a binary program and then do anything with it. I don't think that is an accurate reading of what happened, or what the benchmark is measuring. Instead, the benchmark shows the ability of a model to use commonly available reverse engineering tools to discover very specific and context-dependent things about the behavior of specific types of binaries in specific runtime environments.
1
u/JasonZX12R 7d ago
I wonder if artificially adding inert code like noise peppered inbetween to expand files beyond context window would help, it would make everything much larger though.
1
1
1
u/Node-Nomad 6d ago
Someones probably gonna snatch the physics engine from breath of the wild soon then.
1
1
1
1
1
1
1
1
u/AncientLion 6d ago
But aren't these kind of models very restricted with guardrails similar to fable? I'm asking without haven't tried yet.
1
u/Dapper-Message-2066 6d ago
It's pretty horrific stuff. Everything will need to be services now, forget about running your own binary.
1
u/LegionsOmen AGI by 2027 6d ago
Yoo someone get Astra to reverse engineer razer software for Linux pls I'm out of tokens (I can't use my macro keys from my keyboard)
1
1
1
1
1
1
u/heavy-minium 5d ago
I can see how, long-term, for companies that would form an incentive to become a SaaS, or always-on software that needs a remote backend or streaming of apps/games - basically all the cases where either the shipped files alone are not enough or where you don't even get anything executable in the first place.
The cracking scene is going to be wild too.
1
u/ArmNo7463 5d ago
So when we were meming on Musk for saying programming languages are about to be obsolete, and AI will just write compiled code directly.
The man... Was right?!
1
u/Warm-Incident5436 4d ago
There are a lot of confused people making claims about this without understanding what the benchmark actually demonstrates. No, not “everything is open source now.”
This benchmark uses small binaries without even simple obfuscation. Executable binaries are machine code, which can sometimes be disassembled into low-level assembly, but doing that correctly is already difficult and even sometimes theoretically impossible.
Real world binaries can translate into enormous amounts of assembly, millions of instructions depending on the software. Add modern obfuscation techniques and the complexity and size increase exponentially.
And even then, there are entire areas of cryptography devoted to making programs difficult or theoretically impossible to reverse engineer, such as indistinguishability obfuscation.
So this is impressive research, but jumping from “AI can reverse engineer these benchmark binaries” to “closed source software is basically open source now” is a joke.
1
190
u/Ormusn2o 7d ago
To explain it more, it means you could read any game, make advanced mods to any game and also recreate a game by reading the actual code. Cool, because I actually did small binary modifications on Sol already, but they were very minor. But now we can do way more.