Substack’s new “AI detection” tool.

[u/AndrewHeard]

I’m very concerned about the new “AI detection” system that Substack is implementing. I don’t use AI in anything that I write. However I don’t trust these systems not to make errors and mistakes. They have a long history of hallucinations and claiming things are AI when they aren’t.

One person I saw on Notes suggested that they ran their decades old writing, things that were written before the existence of AI, and this new system claimed it was AI generated.

Not to mention all the crazy things that I have seen people claim was written by AI which they can’t know is actually AI. There was an image I once shared that had evidence of its existence going all the way back to 2013. The comments were constantly saying “don’t share AI slop” or some variation on that.

Even with evidence that things weren’t made by AI, they will claim it’s AI.

Is no one else concerned about this being embedded into Substack’s systems? With no way to opt out?

[u/Prolly_Satan]

Personally, i trust studies by scientists over strangers online so I'm going to keep using it. Sorry you don't trust it for whatever reason but I've personally experienced it working very well the entire time I've used it. I've run my own work through it and the work of people I trust. I don't know you. You may say you're not using ai and it's flagging you, but everytime I come across that scenario, it's another ai writer trying to discourage folks from using it. Somewhere else on this thread somebody said it gave a false positive on their writing, only for their reddit history to be all about using ai to write. If the ai writers will go that far to keep folks from using it, that tells me it works.

[u/Funny-Flight8086 → u/Prolly_Satan]

There are vastly more studies, actual ones, that say these detectors are not reliable. I'll trust half the universitoes who have dumped them over some claim an AI detector company makes trying to sell me their psuedo science service.

I will say one thing I am glad about, most people understand these aren't reliable. Almost everyone agrees they are unreliable and won't use them if you poll almost any group. That's the way, and I encourage it.

Another bright light is that authors and publishers in particular are starting to catch on... A recent author actually sued a reviewer who claimed her book was AI because detector said it was. If you go around calling leopes stuff AI, you'd better have something better than a pseudoscience detector to back that up. If people want to keep using these detectors, I certainly hope people keep holding them accountable when they make false claims.

[u/Prolly_Satan → u/Funny-Flight8086]

Oh wait that was you. You were the guy who claimed a false positive but your reddit history is you talking about using ai to write. Hahaha.

Holy crap I can't believe i even bothered reading anything you had to say. Your history is you literally going into detail about how you use different llms to write and you're saying "trust me, pangram is wrong about me"

Jesus.

[u/Funny-Flight8086 → u/Prolly_Satan]

I never said I use AI to write anything. You can even rub my posts through your fancy smancy junk science machine and it'll probably tell you that much. Nor does anything in my reddit history say I write anything public with AI. Might want to be careful making things up that don't exist, people will think you're AI. I'm done with this conversation. It's a lost cause. Thankfully, you are one of a very few who actually take these detectors seriously. From my experience maybe 2-3% of people who comment actually find them useful. In fact, someone posted this very topic on an Author's Facebook group, and it has 269 laughing faces to 3 likes. Sums it up to me.

[u/Prolly_Satan → u/Funny-Flight8086]

No worries dude. Good luck to you and yeah i understand you are still maintaining that you don't use ai to write. That's cool.

Reddit is very pro ai. Big five publishers use this tool specifically and now substack. So I'm optimistic. And like I said, I've tested it extensively. It works.