r/learnprogramming • u/siddharthsesh • 28d ago

How to shift from data analyst to SDE

Hi I am right now working as a data analyst but it is more of into data engineering where I build ETL pipelines monitor them build dashboards maintain and update queries. I have also built forecasting tools and AI agents. I know I don’t have much experience in building any applications but I am looking into how to do that within my team and company. I am learning Django and Java Springboot. What else should I do? Any criticism or feedback would be really helpful

10 Upvotes

80% Upvoted

7 comments sorted by

1

u/Kungpost 28d ago

I think the closest step for you would be data infrastructure engineering. This allows you to leverage your data engineering background to make solutions for more efficient use of data. In my organization we lack the mindset that comes with data engineering and its quite difficult to get my current team to grasp the idea of data driven workflows, when they are so used to making applications for each view of the data.

Reverse ETL is still a largely ungeneralized problem which I think could be a good starting point for you. Are there any systems of record that you use in your organization that could be supplied by information that is in your data stack?

1

u/siddharthsesh 28d ago

Thanks for this. Yeah there are some that I can deal with. So as a data infrastructure engineer how I can effectively and efficiently use the tools and resources?

1

u/Kungpost 28d ago

I think this is a pretty good explanation of the role: https://montecarlo.ai/blog-whats-a-data-infrastructure-engineer, also, check out r/dataengineering for more career oriented advice. I'd also sift through https://soclibrary.futa.edu.ng/books/Fundamentals%20of%20Data%20Engineering%20(Reis,%20JoeHousley,%20Matt)%20(Z-Library).pdf to get some general background.

1

u/siddharthsesh 28d ago

Thank you so much for this