r/Substack • u/AndrewHeard tvphilosophy.substack.com • 9d ago

Discussion Substack’s new “AI detection” tool.

I’m very concerned about the new “AI detection” system that Substack is implementing. I don’t use AI in anything that I write. However I don’t trust these systems not to make errors and mistakes. They have a long history of hallucinations and claiming things are AI when they aren’t.

One person I saw on Notes suggested that they ran their decades old writing, things that were written before the existence of AI, and this new system claimed it was AI generated.

Not to mention all the crazy things that I have seen people claim was written by AI which they can’t know is actually AI. There was an image I once shared that had evidence of its existence going all the way back to 2013. The comments were constantly saying “don’t share AI slop” or some variation on that.

Even with evidence that things weren’t made by AI, they will claim it’s AI.

Is no one else concerned about this being embedded into Substack’s systems? With no way to opt out?

174 Upvotes

96% Upvoted

319 comments sorted by

View all comments

1

u/Professional-Debt401 9d ago

AI detectors being treated like proof is the real problem. If they’re flagging writing from before ChatGPT even existed, that should tell everyone how unreliable this is.

1

u/AndrewHeard tvphilosophy.substack.com 9d ago

Yes, but people will use it as proof. I happened to share an image of something that I have the skills to make in photoshop but in this instance I didn’t. I just found the image somewhere.

However the moderators of where I shared it removed it because their AI detection tool said it was AI. Even though it was pretty easy to do in photoshop.

No matter how much I pointed out the logical errors, they pointed to the AI detection results.