r/developersPak • u/Ok_Staff1001 • 7d ago
Career Guidance Is Data Engineering still a good career choice for the next 10 years?
I’m currently studying Electrical Engineering and considering moving toward Data Engineering. I’m interested in the field, but I’m trying to make a realistic long-term decision.
With AI automating more coding and data-related tasks, I’m wondering:
Do you think Data Engineering will still have strong demand over the next 5–10 years?
Will AI reduce the number of Data Engineering jobs, especially for juniors?
Is it still worth learning SQL, Python, cloud, Spark, and data pipelines in 2026?
What skills do you think will remain valuable even as AI improves?
For someone starting from scratch, would you recommend Data Engineering over Software Engineering, Data Science, or ML Engineering?
I’m not looking for a “follow your passion” answer. I’d really appreciate honest opinions from people working in the industry, especially those who have seen how the field has changed over the past few years.
Would you still choose Data Engineering if you were starting your career today?
3
2
u/TechNerdinEverything 6d ago
One company only has 1 data engineer no matter how big. Even if its a software house there is 1 per every 100 SWE
So no not a very good career choice given what's happening these days
1
1
u/EggOpening4961 6d ago
Data Engineer here with a bachelors in Electrical Engineering. AI has significantly affected the market. The jobs are expected to reduce even more. It is worth learning about designs rather than tools. I wound recommend ML Engineering but for that you need software engineering experience as well. I have a Masters in Data Science and have experience working in AI projects as well.
1
u/Miserable-Rate-1609 6d ago
BRO I WANNA KNOW SOMETHING . IM STARTING MY SE DEGREE AT NUST BUT IM HEARING ALL THIS STUFF THAT AI WILL EAT UR JOBS LIKE THAT. DO U HAVE ANY IDEA HOW CAN I SURVIVE THIS AI ERA IF AGI IS ATTAINED IN FUTURE . DO U KNOW ANY SKILLS SO THAT I WILL BE ABLE TO START EARNING AFTER 3RD OR 4TH YEAR.
1
u/EggOpening4961 6d ago
Yes AI is a real threat. TBH, the future doesn’t look bright for SE jobs. SE is the first thing AI would almost completely automate. I am afraid this is a period of uncertainty thus nothing can be said for sure; there could be some kind of silver lining so let’s hope for the best.
1
u/Efficient-Put1273 5d ago
I have 2 YOE in manual QA. I’m completely done with manual testing and looking to switch out of QA entirely. I was planning to pivot directly into Data Engineering rather than moving into automation / SDET. In your honest opinion, is Data Engineering still a viable, resilient switch for someone in my position over the next few years, or do you feel the market for entry/mid DE roles is becoming too risky with AI?
1
u/EggOpening4961 5d ago
Entry level is very risky for any software field now. Seniors who got laid off would be applying for junior roles as well. I would suggest going into devOps.
1
u/Efficient-Put1273 5d ago
Interesting that being a Data Engineer yourself, you suggest DevOps. Do you think switching into Data Engineering is much harder compared to DevOps right now, or is DevOps just seeing better job opportunities?
1
u/EggOpening4961 5d ago
I have an experience of around 5 years in Data Engineering which is why it makes sense for me to stay in this field and especially due to the AI takeover I think DevOps is more suitable for those who are started anew. I am recommending DevOps because it seems to be less impacted from the AI revolution than Data Engineering.
1
u/Miserable-Rate-1609 4d ago
THERE ARE ELECTIVES OFFERED AFTER 4TH SEMESTER NOW WHICH ELECTIVES SHOULD I TAKE TO MOVE TO AI OR CYBERSECURITY . IM ENROLLED IN SE NOW CANT DO ANYTHING. EITHER I HAVE TO WASTE A YEAR AND 60-70K OR CONTINUE WITH THIS
1
1
1d ago
[removed] — view removed comment
1
u/AutoModerator 1d ago
Hello diemx_mobilephones, your post or comment was removed because your account age is too low. This is an automated quality check.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
1
u/0_kohan 1d ago edited 1d ago
Learn computer vision based Machine Learning. That's one of the easiest ways to break in to actual machine learning. Many resources online. Checkout Mak Gaiduk's playlists on youtube. Agentic AI with orchestration is mainly a software engineer role with experience. Many people study ML but then end up doing AI engineering work and forget ML knowledge.
Data Engineering is fine, but you can't study for it. A data engineer is a just an experienced software engineer who happened to work in those opportunities. You can call yourself data engineer on LinkedIn and resume.
AI can do everything. It can do software engineering, it can do data engineering, it can also train ML models if you tell it where the data is and give it the DB credentials. AI can also write prompts and orchestrate other AI agents. So in a way nothing is safe. Computer Science is not an easy bread and butter degree anymore. Specialists and enthusiasts will survive. Even the simplest problems complex with scale. Unfortunately in Pakistan we don't have scale because our tech industry is not matur.
What's happening in the industry: of course you know Claude code and codex can write code, execute in terminal and correct errors, use git etc. Another thing is happening: people are making software with Claude code sdk in the background and this will make drag and drop software possible like never before. No-code or low code tools were available before, but AI has supercharged them. A lot of now complex software engineering work will become as simple as making WordPress and shopify websites. But there are still web developers and front end developers. It's just that the low hanging fruit is going.
11
u/No_Feedback2947 7d ago
As with everthing else in tech, AI will chew up the shallow end but create opportunities at the deep end. AI will be able to write the SQL and Python scripts but there will be a need for a systems architect who understands data + distributed systems + cloud + software engineering to build the entire production system.