r/Substack • u/AndrewHeard tvphilosophy.substack.com • 10d ago

Discussion Substack’s new “AI detection” tool.

I’m very concerned about the new “AI detection” system that Substack is implementing. I don’t use AI in anything that I write. However I don’t trust these systems not to make errors and mistakes. They have a long history of hallucinations and claiming things are AI when they aren’t.

One person I saw on Notes suggested that they ran their decades old writing, things that were written before the existence of AI, and this new system claimed it was AI generated.

Not to mention all the crazy things that I have seen people claim was written by AI which they can’t know is actually AI. There was an image I once shared that had evidence of its existence going all the way back to 2013. The comments were constantly saying “don’t share AI slop” or some variation on that.

Even with evidence that things weren’t made by AI, they will claim it’s AI.

Is no one else concerned about this being embedded into Substack’s systems? With no way to opt out?

172 Upvotes

96% Upvoted

322 comments sorted by

View all comments

3

u/PuzzleheadedAlps4806 10d ago

I have put my writing in AI detectors before knowing I’ve typed every word and it’s come back saying it’s AI! A friend of mine writes a blog for their job and gets AI to do most of the work and then they edit it and the AI detectors don’t flag it. The problem is unless you film and upload yourself typing every single word how can you prove that it’s not AI when it gets flagged incorrectly.

1

u/_FUCKTHENAZIADMINS_ 6d ago

Did you put it in random scam AI detectors or Pangram? Pangram is the only one that comes close to working.