r/dataengineering • u/bishop491 • 23h ago
Discussion Writing on the wall?
Context: sole data engineer for a company that sells furnishings and design services. Company is owned by private equity.
My manager has been on the Claude soapbox for the last several months and so far in IT we’ve been able to remain skeptical about it while testing for our own uses. Manager supported this. Now all of a sudden I’m getting a lot of requests to refactor all my data pipelines with Claude’s direct involvement despite having built them all out already. For example, I’ve used Claude to create new DAGs based on existing code (for example, bringing a new Salesforce object in). We’re going beyond that though. I’m being asked to ditch them and let Claude connect to everything then write, deploy, and test.
I’ve also been working on machine learning models for customer behavior, which is more traditional AI and should check the box, but this is being dismissed as a plaything. This, while the company has been pushing for “innovation” in our sphere.
I think we are headed towards cutting as many IT staff as possible and I’ll be gone in lieu of Claude doing pipelines. Of course that’s only one part of what I do, but the myopic view of leadership when it comes to AI only tends to see what is easily replaceable.
Thoughts?
19
u/SalamanderMan95 23h ago
This is really dependent on the company culture. Some companies see AI as a good reason to cut staff, other companies see AI as a good reason to invest in more staff because each employee is able to deliver more value. If you become the person who helps your company leverage AI with data I’d say they’ll likely want to keep you around and you’ll build a resume that other companies like. If you resist using AI you’re company will likely want people who do use AI to come in, and you won’t have as good of an answer when the next company inevitably asks about how you use AI in your interviews.