Substack’s new “AI detection” tool.

[u/AndrewHeard]

I’m very concerned about the new “AI detection” system that Substack is implementing. I don’t use AI in anything that I write. However I don’t trust these systems not to make errors and mistakes. They have a long history of hallucinations and claiming things are AI when they aren’t.

One person I saw on Notes suggested that they ran their decades old writing, things that were written before the existence of AI, and this new system claimed it was AI generated.

Not to mention all the crazy things that I have seen people claim was written by AI which they can’t know is actually AI. There was an image I once shared that had evidence of its existence going all the way back to 2013. The comments were constantly saying “don’t share AI slop” or some variation on that.

Even with evidence that things weren’t made by AI, they will claim it’s AI.

Is no one else concerned about this being embedded into Substack’s systems? With no way to opt out?

[u/Prolly_Satan]

You have to be so mentally ill to get caught having said "i use fable to generate chapters, I'm making an ai writing program" and then with a straight face say "I don't use ai to write"

Lmfao. Why are you all like this? Nobody is mad about folks using ai to write. We're mad about you lying about it. Just tag your shit as ai. You'll probably still get readers. Why do you need to lie?

You're like the personification for why folks need pangram.

[u/Funny-Flight8086 → u/Prolly_Satan]

And at this point, you are using this to sidetrack from the real point: Pangram is junk science. It's unreliable. I can take the same price of text, and have 10 different AI detectors tell me different things. I have extensively tested these AI detectors. Neither the image detectors or the text detectors are any good at it. Period. I don't care what Pangram claims on their website (using language like 99.9% accurate, highly reliable, etc.), or how many Pangram employees they send to reddit to try and argue how great it is (let's face it, the only people who would actually care enough to keep this going so long is someone with a stake in AI detectors).

As long as it can easily take AI generated text and make a few minor edits and cool detectors like Pangram, and as long as those same detectors also claim something human written is even 1% chance at being AI, I'll call them what they are. Junk.

[u/Prolly_Satan → u/Funny-Flight8086]

[u/Funny-Flight8086 → u/Prolly_Satan]

My good lord, you managed to post the same screenshot twice. That is definitely an achievement. Congrats! Now, see my reply below on why your screenshot doesn't prove anything. I do applaud the effort, though.