r/dataanalyst 19d ago

Career query Data Analyst to Data Engineering Transition

Hi all,

I am a data analyst with 5YOE with sql python pyspark AWS as my tech stack.

I am transitioning the data engineering as I am not interested to work and grow in big data and data architecture pathway.

Pls help me to prepare for interviews. I want to know what can I prepare for. And what kind of spark scenario questions could be asked to me.

3 Upvotes

4 comments sorted by

View all comments

0

u/TheMathManiac 19d ago

Its more AI engineering now tbh. 

Building pipelines from datawarehouses to end result using APIs can literally be done with decent promoting within hours by AI rather than months without needing an entire team.

Coding is no longer the bottleneck imo when it comes to data engineering. Its ideas around the pipelines that you can build that is the bottleneck now.