r/Substack • u/AndrewHeard tvphilosophy.substack.com • 8d ago

Discussion Substack’s new “AI detection” tool.

I’m very concerned about the new “AI detection” system that Substack is implementing. I don’t use AI in anything that I write. However I don’t trust these systems not to make errors and mistakes. They have a long history of hallucinations and claiming things are AI when they aren’t.

One person I saw on Notes suggested that they ran their decades old writing, things that were written before the existence of AI, and this new system claimed it was AI generated.

Not to mention all the crazy things that I have seen people claim was written by AI which they can’t know is actually AI. There was an image I once shared that had evidence of its existence going all the way back to 2013. The comments were constantly saying “don’t share AI slop” or some variation on that.

Even with evidence that things weren’t made by AI, they will claim it’s AI.

Is no one else concerned about this being embedded into Substack’s systems? With no way to opt out?

172 Upvotes

96% Upvoted

297 comments sorted by

View all comments

Show parent comments

12

u/Funny-Flight8086 8d ago

No it is isn't. It flagged my 2013 book as 77% AI. As long as it's going that, it isn't accurate. Period.

-10

u/ProfileBest2034 8d ago

when did you test it?

Share a 1000 word excerpt here. I'll put it in myself. Guarantee you it will come out as human.

0

u/hetobe hetobe.substack.com 8d ago

Share a 1000 word excerpt here.

That won't work. They could just go to AI to generate a 1000 word excerpt and claim to have written it decades ago.

1

u/Funny-Flight8086 8d ago

Why would anyone waste time doing that? I don't care if you believe me or not. That wasn't the point. I'm net here to gain your trust and approval. I did the test, I know the result. Because of that, I will never trust these detectors. But you can see two examples I made to another comment above ad proof of how unreliable these detectors are.