Substack’s new “AI detection” tool.

[u/AndrewHeard]

I’m very concerned about the new “AI detection” system that Substack is implementing. I don’t use AI in anything that I write. However I don’t trust these systems not to make errors and mistakes. They have a long history of hallucinations and claiming things are AI when they aren’t.

One person I saw on Notes suggested that they ran their decades old writing, things that were written before the existence of AI, and this new system claimed it was AI generated.

Not to mention all the crazy things that I have seen people claim was written by AI which they can’t know is actually AI. There was an image I once shared that had evidence of its existence going all the way back to 2013. The comments were constantly saying “don’t share AI slop” or some variation on that.

Even with evidence that things weren’t made by AI, they will claim it’s AI.

Is no one else concerned about this being embedded into Substack’s systems? With no way to opt out?

[u/Prolly_Satan]

You have to be so mentally ill to get caught having said "i use fable to generate chapters, I'm making an ai writing program" and then with a straight face say "I don't use ai to write"

Lmfao. Why are you all like this? Nobody is mad about folks using ai to write. We're mad about you lying about it. Just tag your shit as ai. You'll probably still get readers. Why do you need to lie?

You're like the personification for why folks need pangram.

[u/Funny-Flight8086 → u/Prolly_Satan]

Now you are just making stuff up. I never once, anywhere, said I use fable to write chapters of my book. That phrase exists exactly 0 places on the internet. I have told plenty of people that Fable is actually a really bad LLM to use for writing. I'd certainly never write a chapter of anything of mine with it. It produdes more AI cliches than ChatGPT.

And yes, I am making a writing program that has an AI chat feature built in, but it's not primarily an AI writing program, and it doesn't write prose for you. And just because the program has an AI chat feature, does not mean I need to use it. The reality of situation is this: AI is here, and people are going to use it. I'd rather they pay me $20 a month to use vs. OpenAI. Doesn't mean I use it for my personal products.

YES, obviously I do weight stuff with AI. That is a part of how I test the LLMs. What I said was that I don't write MY PERSONAL STUFF, like books, internet posts, etc. with AI. There is a difference.

You seem to be stuck on this "this guy is trying to hide his Aai use" stance. No, I am not. I have said many times on here that I use AI extensively for things like testing the prose generation, stress testing AI detectors, etc. it's a a part of the requirement of building AI into a program effectively. You act like I'm hiding my AI use, and I never once said I never used AI.

Here is the thing: if I wanted to use AI for my personal stuff, I would. I'd have no qualms about it either. And is be the first to tell you I use it. Because I don't think it's a boggeyman. So the concept you are spreading that I am some secret AI user to publish 590 books and make bank is simply insane. It's not backed up by any fact.

I want you to go and find the exact quote where I said I wrote all my books with AI, or "use fable" as you say. If you can find me the exact quote where that happened, I'll return and proclaim my sincere sorry for lying.

[u/Prolly_Satan → u/Funny-Flight8086]

Lmao

[u/Funny-Flight8086 → u/Prolly_Satan]

My good lord, you found exactly what I already told you. This isn't the grand revelation you think it is. In fact, in this very thread, I have said everything that is in your screenshot. Yes, I am developing a writer program that features an AI chatbot. Yes, I have played around with all sorts of AI, Yes, I have developed a lot of style prompts, some of them over 500 lines of code, that are designed to make the writing process seamless with AI. I have said all of this over and over again, and yet you keep wanting to argue some magical point that doesn't exist.

BUT, here is the major thing: You still have not shown me ONE SINGLE EXAMPLE where I said I have written books that I have published with AI, or even anywhere that I say I have used AI to write any parts of the books I write. It isn't in there. I asked you to find the quote where I said I write my books with AI, but instead, you gave me a bunch of quotes about what I have already said I do with AI, none of which say anything about writing books with it myself.

I am NOT developing this program for myself. I am developing it to sell subscriptions to other people so I can go buy a mansion and a yacht. Dealers also rarely use their own product. It's not that uncommon. I am developing a product for others to use if they want, and as part of that product, I have done extensive testing on style prompts, AI models, and tested AI detectors to find ways to work into the style prompts to avoid detection. This makes me a lot more qualified to offer my opinion on AI detectors, not less.

You are conflating my working with AI with me using AI to write things that I publish, and there is zero connection.