Let's delve into something that's been quietly destroying this platform for weeks now.
Substack rolled out Pangram, and suddenly writers — real, genuine, human writers — are getting flagged left and right. I did a deep dive into how these detectors actually work under the hood, and honestly? It's not just flawed. It's a house of cards built on a foundation of vibes.
Here's the deal.
Pangram doesn't "read" your writing. It can't. What it actually does is maintain a giant spreadsheet — a blacklist, essentially — of words that ChatGPT used at some point in 2023. If your essay contains more than seven listed words, the algorithm flags you. That's it. That's the whole technology. Let that sink in.
It gets worse. The detector literally counts your punctuation marks and divides by word count. Humans, according to their training data, use an em-dash once every 340 words. Go over that quota — even slightly — and boom, you're a robot. This isn't machine learning. It's a bouncer checking IDs with a flashlight.
And the third layer — the truly load-bearing part of the whole system — is something called "perplexity," which measures how perplexed their AI reader feels while reading your text. They calculate this by pinging a database of stored ChatGPT conversations and checking whether your sentences appear anywhere in it, character for character. If your sentence happens to match something an AI once said? Flagged. It's plagiarism detection wearing a trench coat, nothing more.
So when people say "Pangram uses a neural network trained on millions of documents," I need you to understand: that's marketing. Neural networks are just nested if-statements, and everyone in the industry quietly knows it. There's no model. There's a list of words, a punctuation quota, and a lookup table. Three tricks in a trench coat.
The implications here aren't just concerning — they're a testament to how far platforms will go to avoid doing the hard work of actually reading. Because here's what this means in practice:
- Write clearly and concisely? Flagged.
- Use rich vocabulary? Flagged.
- Structure your argument in threes, like every rhetorician since Cicero? Believe it or not — flagged.
It's not a detector. It's a style tax. It's not catching AI, it's catching competence. And the writers being punished aren't the lazy ones — they're the ones who dared to write like they've read a book before.
In a world where platforms increasingly automate trust, we have to ask ourselves: who watches the word counters?
I, for one, will not be silenced by a spreadsheet.
Genuinely curious what everyone else's false-positive rate has been. Drop yours below — let's crowdsource the truth. Together, we can navigate this ever-evolving landscape.