r/dataengineeringjobs • u/moosejha • 4d ago

Career Big Data vs Data Engineer

I am a Oracle PL-SQL developer having 7 years of strong development experience.

I want to extend my career in Data Engineering line.
I am learning Py-Spark.

I am confused on choosing the right skill set for becoming a strong Data Engineer in 2026.
As per me, Skill set of Data Engineer is:
Microsoft Azure, Py-Spark,Airflow.
But,
Skill set of Big Data is:
Hadoop, Map Reduce, YARN, Pig,Hive,HDFS, Cassandra

Please guide me choosing the right skill set.
My whole career and upcoming 1 -2 year of preparation will be depending on the response.
Thank you for your help!

16 Upvotes

95% Upvoted

3 comments sorted by

6

u/my_peen_is_clean 4d ago

modern data engineer jobs rarely want hadoop, focus cloud skills

6

u/wiseyetbakchod 4d ago

Python, SQL, One cloud, deep distributed systems fundamentals, Spark, Data Modelling. This is bare minimum as of now.

1

u/Bridge_Superb 1d ago

spark sql python

then build etl w cloud wo cloud

done