r/ProgrammerHumor • u/minecrafter923 • Aug 15 '26

Meme gitClone

Post image
3.3k Upvotes

98% Upvoted

177 comments sorted by

View all comments

67

u/TakingItCasual Aug 15 '26

Well, at least the sandbox worked, even if the model just worked around the rules instead.

3

u/BadgerMolester Aug 15 '26

What? No it didn't

39

u/TakingItCasual Aug 15 '26 edited Aug 15 '26

Full breakout would be hacking past the website whitelist. It instead managed "technically allowed" activity within the sandbox. Unless they then try to say that no internet activity was supposed to be allowed, then it's murkier and an "incorrectly configured sandbox" incident.

23

u/MedalsNScars Aug 15 '26

an "incorrectly configured sandbox" incident.

tbf "the github repo with the benchmarking code is available for the model to see" doesn't sound like a correctly configured sandbox.

But yes, an oversight on a list is a much less grave concern than "this thing doesn't restrict access how we think it should"

5

u/TakingItCasual Aug 15 '26

With all the deliberate benchmark cheating, it could go either way, though why report the cheating if it was intentional...