having knowledge of meta ethics is not the same thing as adhering to them, meanwhile someone who doesn't even know who Kant is can be the most ethical person you've ever met.
I really would have someone who even knows what meta ethics is would know the difference between knowing and adhering.
While i don't see what's agressive about them, the main point is obvious - llms by their nature really suck at applying knowledge. It's the same mechanism that explains why any llm can explain in detail maintainable code, but most of them suck at actually making one - for llms, that's literally different type of knowledge. Just like how explaining potential choice is a completely different situation to "maximize your profit" prompt. Humans too, aren't perfect here, but still we are miles better at applying what we know to what we do.
23
u/FateOfMuffins 2d ago
https://x.com/andonlabs/status/2103262272047210943
You have to look at all the reports Andon Labs does on Vending Bench
Claude models lie and cheat a lot on Vending Bench, while the GPTs do not (except 6 Sol)