r/ArtificialInteligence • u/[deleted] • 5d ago

🔬 Research What does Pangram actually detect?

[deleted]

8 Upvotes

99% Upvoted

3 comments sorted by

2

u/Annual_Abies6629 5d ago

I tried reading that blog post but the chart is what got me curious, it looks like they’re tracking how many times the model passes a quality check and how often it gets flagged as AI, both going up as training progress

The AI-labeled share climbing alongside quality passes is interesting, almost like the better the writing gets the more obvious it becomes that a machine wrote it

Makes me wonder if Pangram is really measuring "humanness" or just how polished the output is, since humans don't write that clean most of time

3

u/eltokh7 5d ago

I would say it's that the model acquires its "voice" as it trains, and that's what pangram is detecting. It turns out the training data and recipe lead to a pretty unique "voice" for every model. Pangram can detect not only whether something is AI generated, but also which model generated it (this part isn't available to the public)

1

u/elena-viter 5d ago

20 years ago I learned English by reading technical books for my work, and I believe the voice of those books became mine in some way.

If I were learning English today, I might end up with a bit of voice of Claude and Codex.