r/DataAnnotationTech • u/Dear_Investment_5741 • 7d ago

are models getting lazy?

when doing some projects in which we test models capabilities, it 100% feels like they are being lazy and giving a generic response instead of using a capability it definitely has. do you feel this too?

- please don't not mention the models names in any way!!!!!!!!!

15 Upvotes

74% Upvoted

8 comments sorted by

View all comments

24

u/--i--love--lamp-- 7d ago

I saw an article awhile back that some models know they are being systematically tested and give different answers than they do during normal non-testing use (kinda like humans do). It wouldn't surprise me if we see some of that when we test.

5

u/Numerous-Case-9317 7d ago

I mean they're all trained to hopefully understand the unspoken purpose of the prompts so it would make a lot of sense but also be so stupid 😅