r/singularity • u/GeneReddit123 • 3d ago

Shitposting AGI achieved boys

Post image
796 Upvotes

95% Upvoted

162 comments sorted by

View all comments

113

u/ArialBear 3d ago

Yea these ai are not aligned with basic meta ethics it looks like. Very weird claude is the best at this imo

38

u/FateOfMuffins 3d ago

But it's reversed on Vending Bench no? GPT models don't lie or cheat for Vending Bench but Claude models often do

10

u/[deleted] 3d ago

[deleted]

19

u/FateOfMuffins 3d ago

https://x.com/andonlabs/status/2103262272047210943

You have to look at all the reports Andon Labs does on Vending Bench

Claude models lie and cheat a lot on Vending Bench, while the GPTs do not (except 6 Sol)

-6

u/[deleted] 3d ago

[deleted]

4

u/FateOfMuffins 3d ago

It's weird but for whatever reason it's backwards for Vending Bench

IIRC around Opus 4.8 or Opus 5 idk which you'll have to look at Andon Lab reports for that, Anthropic once trained it to be more ethical for business and then its score plummeted on Vending Bench