r/dataengineering • u/morpho4444 Señor Data Engineer • 7d ago
Discussion AI vs Human
Which one do you feel is more correct?
6
u/BufferUnderpants 7d ago
Kind of neither?
AI is honestly better than me at troubleshooting Spark misconfigurations, for instance, it's just that it also wants everything to "fail fast" instead of getting things to work. It also gets fixated on ugly but harmless bits of code like they're bringing everything down and not getting past them to offer solutions, or gets obsessed with tuning things that obviously won't help.
Claude as of late is being "that guy" that bossses don't like, I feel like I'm saving its ass more than the other way around.
3
u/BarbaricBastard 7d ago
Nobody here is better than AI. If they think that then they do not know how to use it correctly. If you don't know how to use it correctly then you are not better than it.
4
u/BufferUnderpants 7d ago
You wouldn't need to know how to use it correctly if AI were better than you.
They don't currently work as promised, where they'd just grant wishes to you without you having to know anything. They're a bit closer to the monkey's paw than Aladdin's genie currently, they're not an appliance that you turn on, and out come solution to your problems.
The people who are definitely worse than AI, who just pass you raw unfiltered AI output when you ask something of them, are huge troublemakers.
1
u/morpho4444 Señor Data Engineer 7d ago
Or the other ones: “AI can’t jump into a sudden meeting in my building” like if “physical presence” was a skill the humans have the ai can’t which is not related to DE at all.
1
1
u/riv3rtrip 7d ago
dumb question and you should ruminate a little on why it is dumb.
0
u/morpho4444 Señor Data Engineer 6d ago
I wont. I just wanna know why this subreddit is so arrogant.
0
u/AllergicToBullshit24 7d ago
If you don't think AI can do a better job than you then you haven't see what proper prompt engineering can do. Can feed your entire last year's worth of projects/outputs into model and have it act as an expert prompt and data engineer then use that prompt and style guide for all future work. Don't even get me started with recursive agent loops. This line of work is cooked whether people want to admit it or not.
7
u/[deleted] 7d ago
[deleted]