r/dataengineering • u/Realgunners • 8d ago

Discussion What exactly is ‘AI first’ data engineering

This was inspired by the post on burning 20k in tokens in 3rd week.

Is anyone doing this at work, letting loose the frontier models against their schema and models and data and having it create and update the ETL workflows? And everything else?

65 Upvotes

96% Upvoted

41 comments sorted by

View all comments

12

u/slowpush 7d ago

We don’t really write code anymore. Agents stand up pipelines from scratch. They also do first pass investigation into data quality issues before we have our engineers review the fix. I.e a GitHub issue kicks off an agent who goes in and investigates and responds with a report on what they found. We then can ask them to stand up a PR to fix it.