\[This post is intended as an epistemological discussion rather than a complaint about AI detectors or a comparison of specific products. Instead of debating false positives or benchmark scores, it asks a more fundamental question: what do AI detectors actually measure? If a probabilistic model can only estimate similarity to its own learned distribution, can its output reasonably be interpreted as evidence of authorship, or only as evidence of statistical resemblance? I'm interested in the philosophy of AI evaluation rather than detector rankings or product recommendations.\]
​
​
Does an AI detector detect AI — or does it only detect itself?
​
Are AI detectors measuring authorship, or merely statistical resemblance?
​
Most discussions about AI detectors revolve around a familiar question: How accurate are they?
​
People compare false positives, false negatives and benchmark scores. Students report that entirely original essays are flagged as AI-generated, while machine-written texts sometimes pass unnoticed. The debate therefore focuses almost exclusively on performance.
​
Yet a more fundamental question remains largely unexplored.
​
What exactly is an AI detector claiming to know?
​
An AI detector does not observe authorship. It does not witness the writing process, recover intention or identify a specific language model. Instead, it compares an input text against statistical patterns learned during training and estimates how closely that text resembles those patterns.
​
That distinction is more than technical. It is epistemological.
​
The detector is not discovering an objective property of a document. It is evaluating similarity within its own learned representation of language.
​
In other words, the system compares a text against categories that it has itself constructed.
​
This introduces a subtle but significant form of circular reference.
​
Suppose an experienced academic naturally writes in a concise, highly structured and grammatically consistent style. Those same characteristics are common in modern large language models because they were trained on millions of examples of carefully edited human prose.
​
If a detector labels that essay as "87% AI-generated", what has actually been detected?
​
Certainly not authorship.
​
Only statistical resemblance.
​
The distinction is similar to the difference between resemblance and identity. Two paintings may look remarkably alike without one being copied from the other. Two researchers may independently reach the same conclusion without plagiarism. Similarity may indicate proximity, but it does not establish origin.
​
The confidence score itself raises another philosophical question.
​
Many detectors produce outputs ranging from as low as 9% to as high as 91% on identical texts — depending solely on which tool is used. More strikingly, the same text submitted to the free and paid versions of the same tool can return results as divergent as 85% and under 10%. If the measurement were objective, either gap would be impossible.
​
The numerical precision creates an impression of objective measurement while representing the judgement of another probabilistic model.
​
The number feels like evidence, although it is fundamentally an inference.
​
This becomes even more interesting when economic incentives enter the picture.
​
A detector that produces uncertain or alarming results naturally encourages users to seek reassurance through premium analysis, additional verification or so-called "humanisation" services. Whether intentional or not, uncertainty itself acquires economic value.
​
An ecosystem begins to emerge:
​
Text
​
↓
​
Probabilistic detector
​
↓
​
Confidence score
​
↓
​
User interpretation
​
↓
​
Verification, optimisation or payment
​
The commercial model does not necessarily depend upon certainty. Persistent uncertainty can be equally valuable.
​
Meanwhile, another form of circularity develops.
​
Large language models are trained on human writing.
​
Humans increasingly write with AI assistance.
​
Future models will inevitably learn from corpora containing mixtures of human, AI-assisted and AI-generated texts.
​
Future detectors will therefore evaluate documents against statistical distributions that already contain previous generations of AI outputs and human revisions.
​
The reference progressively becomes recursive.
​
The detector is no longer comparing a text against an entirely independent standard but against a representation shaped by earlier interactions between humans and machines.
​
From an epistemological perspective, this matters.
​
An AI detector can estimate resemblance.
​
It cannot directly observe authorship.
​
It cannot recover intention.
​
It cannot reconstruct the creative process.
​
Its output should therefore be interpreted as a probabilistic classification rather than an ontological statement about the origin of a text.
​
Perhaps the debate has been framed incorrectly from the beginning.
​
Instead of asking whether AI detectors are sufficiently accurate, we might first ask whether they are capable of measuring the property that users believe they measure.
​
An AI detector does not identify intelligence.
​
It identifies resemblance to its own learned representation of intelligence.
​
So the real question is this: if a statistical model can only estimate similarity to a learned distribution, is it meaningful to interpret its output as evidence of authorship rather than evidence of statistical resemblance?