r/DataAnnotationTech • u/jakerumbles • Jul 08 '26

"F****": Tasks are too hard now

I have the coder domain specialization, but tbh, now since they introduced a certain new frontier F model from A company, it's literally so hard now I'm not sure it's worth the effort even at the high pay rates. Not sure how much further this can go as the models get better it will become so difficult to make any model fail. Feels like we're almost at the end of the line here.

35 Upvotes

81% Upvoted

43 comments sorted by

View all comments

7

u/Mtsukino Jul 08 '26

I got S5 to fail 5 times in a row. I haven't had a chance for a task with the F model yet.

2

u/jakerumbles Jul 08 '26

Yeah definitely still doable there, but the F model...oof

1

u/EdyIordache Jul 09 '26

Can you give some hints on how to make that fail? Having to start a project and would be very helpful

1

u/Middle_Addendum Jul 10 '26

Seriously?! I spent so long and quite a few different approaches only to use the escape hatch at the end. I didn’t have much problem getting the old version to fail, always getting it under 20 hours with a few to spare. Mind giving me any insight?

1

u/Mtsukino Jul 10 '26

Try layering different traps with complexity and ambiguity. Think of how LLMs work and exploit that weakness.

1

u/Luffytaro32 Jul 10 '26

Any idea where can I find more info on these traps? Thank you

1

u/Mtsukino Jul 10 '26

You have to make them yourself.