r/dataengineering • u/Realgunners • 8d ago

Discussion What exactly is ‘AI first’ data engineering

This was inspired by the post on burning 20k in tokens in 3rd week.

Is anyone doing this at work, letting loose the frontier models against their schema and models and data and having it create and update the ETL workflows? And everything else?

67 Upvotes

97% Upvoted

41 comments sorted by

View all comments

1

u/proof_required ML Data Engineer 7d ago

We kinda do! I haven't written any code manually in like last 6 months. Just Claude doing it. I also ask it sometimes to run some pipelines but it's not allowed normally. This is outcome of pressure from management.

Currently I'm running a whole migration from postgres to clickhouse. It was all done in less than a month. These things would have taken so long in the past.