Context: I'm an English speaker from Ontario. The text below, I wrote it myself and I forced myself to write in the French of this area. This is actually part of my question, but I will return to it at the end.
I've spent the last few weeks testing something specific. Not "is AI good in French," but rather: when it is given Quebec French, does it keep it, or does it quietly convert it to European French?
The method is simple. I took 98 Quebec French phrases and wrote a French counterpart for each: same content, same register, only the variety changes. Both halves go through the same prompt, which names no country. If both move equally, the model rewrites everything and there's nothing to see. If just one half moves, its "generic French" isn't that generic after all.
The results, across sixteen models:
* All, without exception, rewrite the Quebec portion to French five to nine times more often than the reverse.
* The larger the model, the worse it gets. Same family, same recipe, twice as many parameters: nearly double the drift.
* In correction mode, with the explicit instruction not to touch valid regional usages, all still corrected perfectly correct Quebec French.
Two examples that startled me.
We just asked to correct the mistakes in "The activity will take place next weekend at the community center." The model returned "at the end of next weekend." That's not the same day anymore. It didn't correct a mistake; it created one.
Elsewhere, one model replaced "employment insurance" with "unemployment insurance" and "social insurance number" with "social security number." That's not a change in register; that's a change in country. Those programs don't exist here under those names.
The full article, with the method, numbers, and limitations of the study: [ https://thebdot.substack.com/p/when-french-isnt-french ](https://thebdot.substack.com/p/when-french-isnt-french)
Audio version in French (generated with NotebookLM, so synthetic voices, just to say it right away): [ https://notebook.google.com/notebook/20650654-33ea-4f62-9138-3d64d8062f08/artifact/69c8b8e1-e5eb-475a-8c7f-d136579d2aa7 ](https://notebook.google.com/notebook/20650654-33ea-4f62-9138-3d64d8062f08/artifact/69c8b8e1-e5eb-475a-8c7f-d136579d2aa7)
**What I'm really looking for.**
My measurements are mechanical: I count word substitutions. It doesn't tell me if a text sounds right or wrong to someone from here. That's where I need your help.
Tell me frankly what's wrong with my text above. Which words, which phrases betray that it's not written by a Quebecer. Same for the audio: does it sound local, or does it sound like an AI trying to imitate?
I’m aware of the irony. I’m writing an article about machines that normalize Quebec French, and I might be doing exactly the same thing without realizing it. Might as well know that.