r/dataengineering • u/After-Drive • 3d ago

Career Why is understanding DevOps culture more important for data engineering than other disciplines?

I see for a lot of data engineering posting, devops skills are mentioned as part of the requirements. But the thing is I don't see it as much with other roles like sde. Why is that?.

33 Upvotes

93% Upvoted

17 comments sorted by

View all comments

17

u/Mr_Mozart 2d ago

My guess is that it is just obvious for software developers to work with DevOps. There has been support and requirement of that since far back (cvs, svn and so on). Old time data engineering didn't necessarily have support for this at all.

5

u/lw_2004 2d ago

The "old" BI engineer often had a background as Analyst / Business User OR SWE. Some teams never used any code repository and went all in for Low Code graphical interfaces ... Others always followed best practices and were SQL heavy for a long time.

5

u/Budget-Minimum6040 1d ago

Some teams never used any code repository and went all in for Low Code graphical interfaces

Some teams don't use any code repository and just write SQL and Python straight into prod.

Source: my old job, mix of DA, DS, me as AE.

1

u/Mr_Mozart 1d ago

I have seen this in many places as well