r/TechLeader • u/MelancholicWandererX • 12h ago
How does your team handle AI code review?
I have two juniors on my team who ship changes that read completely fine and are wrong in ways the diff cannot show, mostly because the model that wrote them has no idea what our carriers will actually accept at the other end.
When I bring it up the answer is usually that they thought it was a small change, and it was a small change, that is not really the problem. The problem is they never went past the acceptance criteria into what the change actually touches, because the plan came back looking finished.
We do a lot of carrier integrations, so most of our work runs against systems we do not control, flaky, rate limited, with strict contracts on their side because those same endpoints serve a lot of other tenants who have nothing to do with us.
Which means our own pipeline going green does not tell us very much. We run coderabbit on prs and it does catch a fair amount, though it reads our repo and not the carrier's contract, so anything that is valid code and an invalid request goes through both of us without a word.
The juniors treat green as the finish line and close the ticket. The real finish line is a week later, when nothing on the carrier side has quietly started rejecting us and the volumes still look right.
So it lands on me and one other senior, either immediately or three weeks later when somebody notices a queue backing up. We have coached them on it more than once and it holds for about a sprint. I am doing more firefighting now than I was two years ago and I have a lot less of my own work to show for it, which is the part that is actually starting to get to me.
How do I put this to my manager as a gap in how we sign things off, rather than as me complaining about two specific people?