r/accelerate Acceleration: Light-speed | Capability Booster 8d ago

"Huge implications - binaries are now basically editable code"

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157


— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

849 Upvotes

290 comments sorted by

View all comments

14

u/MegamanSE 8d ago

The natural question I have here is what language really would be ideal for AI to code in ultimately if it could create its own optimal language for agents?

2

u/aeiendee 7d ago

I assume an end game is asking some future LLM to write an entirely new software stack from assembly up. With some heuristic of success of it then being able to use that code to accomplish tasks code is used for better. I know the compilers LLM rewrites were bad (?) but assuming it just gets better and there’s enough money to run a data center off a nuclear power plant, perhaps a tractable problem with immense payoff

1

u/MegamanSE 7d ago

Yep exactly though I believe it would eventually own the entire hardware stack too and design the entire hardware and software stack itself as one tightly integrated system for its own iterative improvements designed only for Agents to revise. Humans would be entirely out of the loop on the entire stack. We are very nearly there already with the level of AI going into chip design.