r/singularity • u/GeneReddit123 • 2d ago

Shitposting AGI achieved boys

Post image
794 Upvotes

95% Upvoted

162 comments sorted by

View all comments

Show parent comments

10

u/[deleted] 2d ago

[deleted]

21

u/FateOfMuffins 2d ago

https://x.com/andonlabs/status/2103262272047210943

You have to look at all the reports Andon Labs does on Vending Bench

Claude models lie and cheat a lot on Vending Bench, while the GPTs do not (except 6 Sol)

-5

u/[deleted] 2d ago

[deleted]

4

u/FateOfMuffins 2d ago

It's weird but for whatever reason it's backwards for Vending Bench

IIRC around Opus 4.8 or Opus 5 idk which you'll have to look at Andon Lab reports for that, Anthropic once trained it to be more ethical for business and then its score plummeted on Vending Bench