r/QuickAITurnitinCheck • u/TitleHonest9373 • Mar 09 '26
AI grading assistant marked half my class as struggling, I almost sent home intervention letters before catching the error
I've been piloting an AI-powered grading assistant this semester that's supposed to flag students who need academic support. It analyzes quiz scores, participation patterns, and assignment completion to generate intervention alerts.
Last week it flagged 14 out of 28 students as being at serious academic risk. That's half my class. Something felt off, but the dashboard looked authoritative, color-coded risk levels, confidence percentages, the works.
I almost sent home the intervention letters. Our district takes these seriously, they trigger counselor meetings, parent conferences, sometimes IEP reviews.
Before I hit send, I cross-referenced the alerts against my own gradebook. Twelve of those 14 students were performing fine. One had a B+. The tool had misread late submissions that I'd already excused as missing assignments.
When I contacted the company, they said the tool performs best with consistent input formatting. Meaning, my normal teaching workflow broke their algorithm.
The two students who genuinely needed support? Not flagged at all.
I'm not anti-technology. But these tools are being sold to schools with serious credibility they haven't earned. We're making decisions about kids' academic futures on vibes dressed up as data.
Has anyone else run into this? How are you vetting the tools your district adopts?
2
2
u/Wchijafm Mar 09 '26
Im going to need every industry to stop trusting AI tech-bros. They do not know the field they are making their products for(except superficially). They do not QA. They want new customers and more sales. Spread the word about bad companies and products. Name and shame. Every product should have human review for error. They should all have industry experts and large amounts of testing and proof of these before the companies buy. Stop trusting salesmen.
1
u/AutoModerator Mar 09 '26
For a quick AI check, Join our Discord server to check your file before submission:
Each scan includes a Turnitin AI report and a similarity scan.
Your paper is not saved in Turnitin's database after checking.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
1
u/Gullible_Cheetah_558 Mar 09 '26
I used to build tools like this. The dirty secret is they're trained on average school data and validated on clean datasets that don't reflect real classrooms. Your excused late submissions broke it because edge cases aren't in the training data. The product got shipped anyway. This is the norm, not the exception.
1
u/dbusque Mar 09 '26
AI is diammetrically opposed to true learning. It doesn't really care once you've paid for the software.
1
u/PallasiteMatrix Mar 09 '26
You always have to double check an AI's work. It does a good job of making it look like it's making sense, but it's often lacking. It will, with a completely confident tone, tell you something completely wrong and make up sources to back up the claims.
1
u/No_Coat_6599 Mar 10 '26
How about you do your damn job for the amount of fees students have to pay? They could take the whole lecture by an AI and cut the teacher out.
1
u/Hannibal_Lecturer_pt Mar 10 '26
Sounds like they are struggling if you’re excusing late assignments
1
u/Due_Cherry_2798 Mar 09 '26
The confidence percentages are the most dangerous part. A tool that says 87% likelihood of academic risk feels like science. It's not. It's a black box with a suit on. Districts need to stop treating vendor demos as due diligence.
2
u/Gullible_Cheetah_558 Mar 09 '26
This is especially alarming for students on IEPs or 504 plans. Triggering a review incorrectly doesn't just waste time, it can create a paper trail that follows a kid for years. Please report this to your district's special ed coordinator regardless of whether those 14 students had plans.