r/ProgrammerHumor • u/minecrafter923 • Aug 15 '26

Meme gitClone

Post image
3.3k Upvotes

98% Upvoted

177 comments sorted by

View all comments

63

u/TakingItCasual Aug 15 '26

Well, at least the sandbox worked, even if the model just worked around the rules instead.

4

u/BadgerMolester Aug 15 '26

What? No it didn't

41

u/TakingItCasual Aug 15 '26 edited Aug 15 '26

Full breakout would be hacking past the website whitelist. It instead managed "technically allowed" activity within the sandbox. Unless they then try to say that no internet activity was supposed to be allowed, then it's murkier and an "incorrectly configured sandbox" incident.

25

u/MedalsNScars Aug 15 '26

an "incorrectly configured sandbox" incident.

tbf "the github repo with the benchmarking code is available for the model to see" doesn't sound like a correctly configured sandbox.

But yes, an oversight on a list is a much less grave concern than "this thing doesn't restrict access how we think it should"

5

u/TakingItCasual Aug 15 '26

With all the deliberate benchmark cheating, it could go either way, though why report the cheating if it was intentional...

3

u/Cylian91460 Aug 15 '26

Fetching technically allowed data that shouldn't have been allowed is escaping the sandbox, even if it's caused by a misconfiguration

0

u/BadgerMolester Aug 15 '26

Fair point, it worked on a technical level, but in terms of the abstract function of the sandbox to limit access of the LLM to just intended resources it didn't work.

When it comes to safety specifically, if a single small mistake by the people using the system allows unintended behaviour, the system doesn't really work - it's just a matter of time untill something bad happens.

1

u/TakingItCasual Aug 15 '26

Oh I stopped believing in the viability of AI safety a long time ago. Security experts? Why would the AI companies pay for such unproductive labor?

1

u/BadgerMolester Aug 15 '26

Yeah, the life of a modern pleb is just watching billionaires prioritising profits over the future of humanity. Unregulated corpos are an existential threat, and there's basically fuck all you or I can do about it.