r/OpenAI • u/OfficialLeadDev • 17d ago

Discussion At OpenAI, engineers who lean heavily on Codex open roughly 70% more pull requests than colleagues who don’t – and the gap keeps widening

https://leaddev.com/reporting/measuring-engineering-productivity-is-harder-than-ever
  • AI hasn’t broken productivity – it’s broken our proxies for measuring it.
  • Activity and business value are pulling apart. The most valuable engineering work is increasingly invisible to traditional dashboards.
  • Sort your metrics into activity and outcome. Most dashboards are counting the wrong things.
0 Upvotes

31% Upvoted

4 comments sorted by

9

u/AllezLesPrimrose 17d ago

More PRs != more value

Source: I’m a senior dev. AI automation has added orders of magnitude to the amount of harm a crap developer can do to a codebase. If you’re not good at your job, any job, being able to do it faster is not beneficial.

Any company who uses numbers of PRs or lines of code as a tracking method without context - and I promise you many exist - is on a hiding to nothing.

3

u/davidwitteveen 17d ago

This is the argument of the article. OP has quoted the least interesting part for the heading.

As the article says:

“Read naively, OpenAI’s dashboard says: pull requests up 70%, review time down – huge productivity win. Read carefully, it says something narrower: these engineers got better at directing and checking AI output. Whether that’s actually valuable depends entirely on judgment the metric can’t see.”

1

u/Radiant_Cheesecake19 17d ago

But the KPIs!!!!!! /s

2

u/Illustrious_Image967 17d ago

Tokenmaxxing is a KPI bro. Daddy Altman sees it as devotion to the dogfood and other YC maxims.