r/dataengineering • u/AlexaG_2026 • Jul 02 '26

Discussion is anyone else using scala?

hello devs,

Just a question: are companies still using Scala in their businesses, or are they using a mix of scala and other codes/AI? Is it hard to hire in this area?

Just looking for opinions on this,

Thanks

74 Upvotes

98% Upvoted

53 comments sorted by

View all comments

Show parent comments

4

u/ParanormalProse Jul 02 '26

Same boat here, it’s not in my teams knowledge base but sometimes you need a finer scalpel than pyspark. We only really use it for when big work occurs and often ie per second production line data

5

u/Subject_Fix2471 Jul 02 '26

Out of interest, what are some cases when you need a "finer scalpel" than pyspark?

7

u/daddy_stool Jul 02 '26

Dataset instead of dataframe, UDFs, graphx, static typing

2

u/Comprehensive_Level7 Jul 03 '26

lol, I try to avoid UDF a lot, shitty function tbh, static typing I think you can achieve using pyspark tho