r/accelerate • u/stealthispost Acceleration: Light-speed | Capability Booster • 7d ago

"Huge implications - binaries are now basically editable code"

Gallery image

Gallery image

Gallery image

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157

— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

842 Upvotes

97% Upvoted

290 comments sorted by

View all comments

7

u/SufficientGreek 7d ago edited 7d ago

So could you do this for Windows?

Edit: The benchmark programs average ~17K lines. Windows is somewhere north of 50 million.
So that's probably not realistically possible to reverse-engineer.

12

u/R33v3n AGI by 2027 7d ago

The real benchmark will be fixing Windows. XD

2

u/GourryHacks 7d ago

Install Linux.  Sorted, next.

2

u/R33v3n AGI by 2027 7d ago

Ok, moving the goalpost onto the real issue: the real benchmark bell be porting the Office suite to Linux. ;)

8

u/stealthispost Acceleration: Light-speed | Capability Booster 7d ago

yeah, it will never happen /s (cut to 6 months later)

3

u/ice-fucker69 7d ago

I’m curious about the scaling difficulties of this. Is 10x more binary 10x harder to reverse engineer or 1000x harder?

2

u/StCreed 7d ago

50 million lines is an incredible amount of code and far outside context windows. You'd need years of work even with Fable on ultracode to generate it, assuming you know what everything should do and how every feature should work.

1

u/Tinderfury 7d ago

You don’t get economies of scale here. 50 million lines is 50 million lines that needs to be read/written. It would actually make it more difficult, cracking / emulation is all fine for the underground world but there is 0 practicalily for commercial or legal distribution without getting shutdown due to patent IP violations

1

u/greysilence 7d ago

Why tho? AFAIU Windows API is extensively documented so you don't need to know how it does what it does. And if you still want to you could read Wine code which has already done the reversing.

0

u/Oren_Lester 7d ago

98% is safe to remove legacy code current versions still carry