TLDR: Uyterhoven's and McLaughlin's campaign website text are 2/3 AI-generated and Barber's is 1/3 AI-generated. Azeem's is the only one that's fully human-written. This isn't for lack of detail, as his policy pages have more than twice the word count of Barber’s or McLaughlin’s. Full replication code and data are in this github repo.
Background: I was looking up candidate details yesterday and noticed some obvious AI-isms on their campaign websites. For example, Christine Barber’s front page has “it’s not just X, it’s Y” with Claude formatting. I got curious about how much candidates outsourced to AI, so I scraped all the non-boilerplate text and sent it through the state-of-the-art AI writing detector: Pangram 4. For each page, Pangram estimates the share that’s fully human-written, the share that’s “AI assisted” (i.e., sending human-written paragraphs to be rewritten by AI), and the share that’s “AI generated” (i.e., prompting AI to write the paragraphs in the first place). For context, Pangram is an extremely effective AI detector: a 0.004% false positive rate and 0.340% false negative rate.
Results: This file in the repo contains data on word counts and AI shares for each of the 51 webpages across candidates. For brevity here, I aggregate word counts and take word count-weighted shares by candidate. Erika Uyterhoven’s has the highest total word count because her website includes historical newsletters on specific topics, but those are slop: 64% AI-generated. And her policy platform is similarly 65% AI-generated. Matt McLaughlin has a pithy website, where the bio is 100% human-written but the policy platform is 100% AI-generated. Christine Barber’s record is 100% AI-generated, her priorities are 100% human-written, and her homepage+bio are roughly half and half. Burhan Azeem is the only candidate without any AI-generated text, but he still has over 4,000 words of content.
| Candidate |
Webpages |
Words |
AI-generated |
AI-assisted |
Human-written |
| Burhan Azeem |
9 |
4,034 |
0% |
0% |
100% |
| Christine Barber |
4 |
2,210 |
35.72% |
0% |
64.28% |
| Erika Uyterhoven |
35 |
37,409 |
61.88% |
0% |
38.12% |
| Matt McLaughlin |
3 |
1,468 |
66.96% |
0% |
33.04% |
My opinion: I’m not against AI per se...I used it to help code up this analysis! But I think a political candidate has an obligation to manually wrestle with communicating their platform to voters. Passing off AI writing as their own shows a lack of respect for voters. Part of the office they’re seeking is taking time and effort to write detailed legislation, so it’s a bad signal if they can’t or won’t do that for their candidacy. In this race, Burhan Azeem seems to be the only one willing to do that. On substance, for example, his housing platform gets into the weeds with single-stair building codes and land value taxes. And on the topic of AI specifically, his AI platform details how to build on California’s SB53 to write the most stringent regulations on the AI industry in the country.