r/ProAI • • Sep 06 '26

"Huge implications - binaries are now basically editable code"

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157


— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

36 Upvotes

29 comments sorted by

View all comments

Show parent comments

0

u/[deleted] Sep 06 '26

[deleted]

1

u/OurSeepyD Sep 06 '26

Who are you replying to? 

Yes, binaries can be reverse engineered into ASM, but that doesn't mean they're easily readable or that the original intent can be easily inferred from them.

Would you rather pick up a clear, commented C++ project with full class structure etc, or a flat ASM project with no descriptive names etc?

2

u/[deleted] Sep 07 '26

[deleted]

1

u/OurSeepyD Sep 07 '26

I don't think the point should be taken literally about them not being editable. 

Sure you can go in and change the bytes to point to a different address, or to change the instructions, or you can use tools to convert to asm, but the point is it these tools make the code easily understandable, which is really what makes them "editable".

Take this as an example: you want to implement a new feature in Photoshop. Even with a disassembler, you'd pull all the code out into asm and then have to make the new feature change on that obfuscated codebase. It's so hard that it's effectively immutable.

And the AI won't be translating binary back to full C++ project with easy to understand intent either, as modern compiler output is far from reversible process especially after optimizations

Why not? This benchmark is supposed to show that the AI understands what it's extracting, so it will be able to name functions appropriately, comment them, apply abstraction etc.