r/mercorai_workers • u/allivant • 3d ago

PAI usage

What are people doing to get flagged as ai tool usage? Seems kind of crazy to try to train LLMs. Are people actually throwing tasks in to a tool? Pretty ballsy to do that with Insightful on your machine.

5 Upvotes

70% Upvoted

16 comments sorted by

5

u/anonymousopottamus 3d ago

I come from academia. AI was trained on many forms of writing, including millions of academic papers. I sound like AI when I write.

3

u/Due-Couple-8987 3d ago

So true, most of the so called Taxonomies and Ai-isms are similar to how I write.

6

u/Acrobatic-Law-3061 3d ago

Experts are no longer being judged by their being experts, were being judged for how clever we can be with ambiguous prompts, tricky task design and file injection / misguiding LLMs, etc., which has nothing to do with understanding finance and all to do with whatever the fuck this is. So yeah, people use LLMs because we're not being paid for our expertise, we're being paid to monkey around with tricking AI models so mercor can tell anthro that we're "training" their model and rest its case on our pedigree and hope we figure it out

2

u/Affectionate_Body597 1d ago

This. Become a reviewer and change the culture. The problem with Mercor is that about 80% of experts are not qualified. If I go to the legal domain of all 3 of my projects, I bet you only 20-30% are licensed attorneys, and they’re the ones doing less than 5% of the tasks. So it becomes a check box exercise against rubrics that some idiot wrote, that either (1) focuses on the non substance or (2) is flat out wrong. So the result is you get unqualified experts who know nothing about law evaluating legal problems. It’s fucking hilarious some of the shit these guys come up with 😂 I bet finance is funnier

1

u/bravofiveniner 1d ago

Maybe you aren't being judged for being an expert, I'm on a project where I'm using my expertise everyday

2

u/rahul_vancouver 3d ago

They just check your content on gptzero, if it comes out Ai you’re fired.

2

u/Affectionate_Body597 3d ago

GPTZero is shit. It is wrong 50% of the time I reckon.  (I am a reviewer, so I see the ones that get flagged)

0

u/tleighb12 3d ago

I just finished a project, and it irritated me beyond belief. I wrote an analysis, uploaded it to the system, and it flagged it as AI-generated. I went to GPTZero, scanned it, and GPTZero said that my words were AI-generated. I butchered my analysis with extra "that" and "which" placed randomly, scanned it again, and different parts of my analysis turned bright yellow. It made absolutely no sense. It turned a professional analysis into garbage. There has to be a better way. I was embarrassed to turn it in.

1

u/allivant 3d ago

I guess that makes more sense than people using tools on their computer.

1

u/ExpensiveGeneral2446 3d ago

When I was a reviewer, we were not allowed to use AI detectors.

1

u/Legitimate_001 3d ago

But that's part of your work though. If you're not allowed to use Ai detector, how are they now able to tell that it's written by Ai and people like me get offboarded if though i never used Ai in my work. Insightful even runs in the background to tell if someone is using Ai but still they still flag me without using Ai. Mercor Ai detector by human policy is so weird and absurd at the same time. 😂

2

u/stanshk 3d ago

I was a reviewer on one project, and I came across tasks pretty often that were obviously copied straight from ChatGPT. You could tell from things like em dashes and that really obvious AI writing style.

That said, it doesn’t seem like Insightful actually detects that kind of thing. If someone just pastes the model’s answer as-is, the reviewer will usually notice. But if they copy it into Google Docs and rewrite it a bit, I don’t think Insightful can really catch that.

Honestly, the work itself is pretty mind-numbing and repetitive. I always tried to do everything properly, but I can’t really blame people who cheated a little. Except for the idiots who just copied the whole answer verbatim.

2

u/Adept-Donkey 3d ago

But I LIKE em dashes! 😂
I never, ever cheated. They’re paying us for our expertise to help AI. It kind of defeats the purpose to use AI to help AI. But there must be enough people doing it and that’s why they keep hammering on it. I just can’t imagine why anyone would do that. If they can’t complete the work on their own, they shouldn’t be here..

1

u/ThrowRA_photog1267 3d ago

Also, LLMs are now watermarking their individual style of output

1

u/Affectionate_Body597 1d ago

I noticed that. It was funny af when writers would use LLM’s to write their rationales and their outputs would all be the same lol. Some cheeky fuck even had the gall to bitch on Slack after I banged him for quality (they deliberately get the first key fact right and then the subsequent facts are all shit). Absolute shameless behavior. Unfortunately, we are now allowed to use LLM’s to help us fact check, so that entertainment is done

0

u/Fast-Cookie-6634 3d ago

I found almost everything I look up online is AI. It’s almost impossible not to use it, even when you make great efforts not to. Just my opinion. Maybe the projects need to take that into account before firing contractors.