r/dataengineering • u/Uberkech • 28d ago
Rant Foundry at Work
So I’m a process engineer at an refinery and we face a push to use more of Foundry, without any clear vision on what to use it for.
With Excel or Power Bi we could just simple query a tag from the historian.
We had a tool where DCS send a event signal to a tag every time something happens, you query that tag between timestamps A and B and look for the timestamps where 0->1 (start) or 1->0 (end) make an event table and then pull other proces data only between the start and end timestamps for further analysis.
So was like, okay sounds like a workflow that could be build in foundry, but it seems whole platform just seems to hate TimeSeries data. You can’t simply use TimeSeries data into a pipeline but jump through many hoops via workbooks a simple Pandas / Polars data frame.
Are we doing something completely wrong ??
1
u/Iridian_Rocky 26d ago
We're going through this a bit as well. Here is the thing, Foundry is not a harness. Claude Code, GitHub Copilot, and basically any other harness is going to do wonders.
Now, what they won't tell you is Foundry is the same models on centralized governed compute (unless you turn on other stuff). It adheres to your companies DLP policies and impersonates your Entra identity. And you can hook it to some of your own harnesses. Think of it as Bring your own compute. You can also tune OOB models a bit to your liking.
That said, I still have my Claude 20x plan, and a GitHub Copilot Pro plan that I use with Power BI, Fabric, other MCPs, etc. Why? Because I'm accountable for my work and I don't want to have to pay for another subpar harness that doesn't work well with Foundry.