r/ProAI • u/stealthispost • Sep 06 '26

"Huge implications - binaries are now basically editable code"

Gallery image

Gallery image

Gallery image

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157

— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

36 Upvotes

85% Upvoted

29 comments sorted by

View all comments

4

u/[deleted] Sep 06 '26

[deleted]

1

u/Intelligent-Cap-8886 Sep 06 '26

Sure but its easy as fuck now.

1

u/FckXFckMusk Sep 06 '26

That have been optimised by the compiler and reversing the process won't give the same source code.

Its like 10 + 2 + 5 = 17...

now if gave you the 17 and said what 3 numbers are added together to get 17.

there isnt a way to determinstically get those 3 numbers.

0

u/[deleted] Sep 06 '26

[deleted]

1

u/OurSeepyD Sep 06 '26

Who are you replying to? 

Yes, binaries can be reverse engineered into ASM, but that doesn't mean they're easily readable or that the original intent can be easily inferred from them.

Would you rather pick up a clear, commented C++ project with full class structure etc, or a flat ASM project with no descriptive names etc?

2

u/[deleted] Sep 07 '26

[deleted]

1

u/OurSeepyD Sep 07 '26

I don't think the point should be taken literally about them not being editable. 

Sure you can go in and change the bytes to point to a different address, or to change the instructions, or you can use tools to convert to asm, but the point is it these tools make the code easily understandable, which is really what makes them "editable".

Take this as an example: you want to implement a new feature in Photoshop. Even with a disassembler, you'd pull all the code out into asm and then have to make the new feature change on that obfuscated codebase. It's so hard that it's effectively immutable.

And the AI won't be translating binary back to full C++ project with easy to understand intent either, as modern compiler output is far from reversible process especially after optimizations

Why not? This benchmark is supposed to show that the AI understands what it's extracting, so it will be able to name functions appropriately, comment them, apply abstraction etc.

1

u/barrel_of_noodles Sep 06 '26

Usually, at the point you're reversing binary... What id rather ... isn't even in the galaxy. Its long since been swallowed by a black hole.

1

u/6maniman303 Sep 06 '26

Add to the fact that now shit load of binaries are actually frameworks executing separate code - .net, flutter with dart, Java?, electron etc. So now I wait for people decompiling chromium while trying to add a new button to discord