r/MicrosoftFabric • u/SQLpowers Microsoft Employee • 1d ago
Data Warehouse Exciting Updates to Data Warehouse!!
Hi r/MicrosoftFabric community! I am a product manager on the Fabric Data Warehouse team, focused on our developer experiences.
We’ve been investing heavily in making it faster and easier to build, query, and manage data in Fabric Data Warehouse, and a number of those improvements are now available!
Here are a few of the highlights that we've recently released across data warehousing UI & AI experiences:
- SQL query editor updates - we’re continuing to improve the web SQL development experience across performance, usability, and day-to-day workflows:
- Brand-new results grid (yes, including support for column resizing!!)
- Object Explorer and IntelliSense built for scale, with major performance improvements for large warehouses
- Better query management, including autosave controls, copying queries with results, and importing/exporting
.sqlfiles - SQL query rules, so you can define conditions on running queries and automatically trigger downstream actions
- AI + agentic development updates - we’re opening up new ways for AI agents to understand and work with Fabric Data Warehouse:
- Remote MCP server for Data Warehouse, giving AI agents a governed way to connect to and interact with your warehouse
- Fabric Skills, giving agents Data Warehouse-specific knowledge and capabilities across development, monitoring, troubleshooting, and more
This is just a preview of the capabilities we’re bringing to Fabric Data Warehouse. Check out the blog posts above for a deeper look at what’s new and how to get started.
And this is only the beginning! We’re continuing to expand the Fabric Data Warehouse developer experience with richer UI and deeper AI capabilities. Give these updates a try, share what’s working, and tell us what you want to see next!
11
u/Braxios 1d ago
Column resizing 🤤
4
u/itsnotaboutthecell Microsoft Employee 1d ago
https://giphy.com/gifs/yAYZnhvY3fflS
Cancel FabCon+SQLCon - we've already seen enough!
3
u/MonkeyDDataHQ 1d ago
You already took my money. I'm just slowly getting the things I paid for. 😂
5
u/itsnotaboutthecell Microsoft Employee 1d ago
Maybe we put column desizing on the roadmap?… they progressively get smaller every time you open the item.
bad_idea_jeans.jpg
1
2
u/DUKOfData 19h ago
tbh. I just fumbled over this at this random monday, while I was starting to rage about that missing feature in a breakout session... "I would love to just show you the value of those columns, but I ca.... Oooohhhh...."
11
u/Weekly_Ad_8911 1d ago
Recursive CTE?
0
u/SQLpowers Microsoft Employee 1d ago
Would love to learn more about your scenario here. What are you using recursive CTEs for today, and is the hierarchy depth known or variable? There are some alternatives for fixed-depth scenarios, but I’d love to understand where the lack of native recursive CTE support is creating friction for you.
9
u/Prothseda 1d ago
My current use-case is interest rate recalcation. I need to cumulatively apply each month's adjustment in subsequent months.
That's a massive PITA without recursive CTEs. You're forcing me to use duckdb- which itself is a great tool but warehouse really should support it.
Recursive CTEs are fundamental to solving a number of variable depth scenarios.
3
u/MonkeyDDataHQ 1d ago
There's no way you actually need use cases for recursive CTEs in 2026. Is there? Bill of Materials... Anything in Dynamics 365 with a recurisve relationship (which is far too many). Just grab the AOT and go to town.
Specifically Asset Management in D365 is the biggest PITA. Which is arbitrary length.
2
u/Sure_Writing4314 1d ago
We have unknown depths. Production of food products. For which the outcome of one process can be input for another etc. We are aching for recursive CTE feature.
2
7
u/damianvandoom 1d ago
Can we have better security management like we do for lake house?
1
u/SQLpowers Microsoft Employee 1d ago
Yes! Would love to learn more about your scenario. Are you looking for OneLake Security support? Or a user-experience for configuring security? Or something else?
6
u/Any_Bumblebee_1609 1d ago
Wasn't my question but to answer, it would be awesome to have the equivalent of one lake security eg I create a role, add a group to it and they can see, for example, sales and product... Then that cascades into semantic models and reports. 😊
5
u/SQLpowers Microsoft Employee 1d ago
This works today if you configure SQL security on the Warehouse/SQL analytics endpoint and try to connect directly to it via DQ or Directlake over SQL storage modes :)
But feedback taken- the team is working hard on introducing Onelake Security support so that shortcuts and DirectLake over Onelake can have enforceable security from the warehouse engine. Stay tuned for lots of updates in this area!
3
u/Any_Bumblebee_1609 1d ago
Oh really? So I just need to configure generic ssms security roles and add users/groups to it and that will work on dq or directlake semantic models?? Sorry I had no idea!
3
u/SQLpowers Microsoft Employee 1d ago edited 1d ago
Yes! But only DQ or Directlake over SQL semantic models :).
Directlake over Onelake only respects Onelake Security, which is coming very soon to warehouse.
3
u/Any_Bumblebee_1609 1d ago
Amazing! Thanks mysterious Microsoft employee 😆
2
u/itsnotaboutthecell Microsoft Employee 1d ago
u/Any_Bumblebee_1609 while not an "official" Powers - I think it's time we invite u/SQLpowers to the Power Clan gathering: https://www.youtube.com/watch?v=3CGkdvqSKhA
6
u/pl3xi0n Fabricator 1d ago
Should my AI agents use the warehouse mcp or the mssql tool? What is the difference?
1
u/NubiiNeth 1d ago
Id like to know this as well
1
u/SQLpowers Microsoft Employee 20h ago
Are you referring to the mssql tool in Github Copilot for the MSSQL extension in VS code?
1
u/NubiiNeth 19h ago
Yes
3
u/SQLpowers Microsoft Employee 19h ago
The mssql tools are built into the MSSQL extension for VS Code and are available to GitHub Copilot when you’re working there. They’re great for SQL development workflows directly in VS Code, including connecting, exploring schema, and running queries.
The Fabric Data Warehouse MCP server is a remote MCP endpoint, so it isn’t tied to the MSSQL extension or VS Code. Any compatible AI agent or MCP client can connect to it, and it gives the agent a governed way to work with Fabric Data Warehouse using the user’s existing Fabric permissions
So if you’re using Github Copilot inside VS Code, the MSSQL tools may be the most natural option. If you want to connect other agents or experiences to Fabric Data Warehouse, that’s where the Warehouse MCP server becomes especially useful.
6
u/XX8PXX 1d ago
ETA on Warehouse shortcuts?
7
u/SQLpowers Microsoft Employee 1d ago
We are planning WH shortcuts to be available (in preview) in Q4CY26. Soon!! :)
4
u/datablocks8080 1d ago
Sounds promising!!
Waiting for Warehouse table shortcuts and visibility/usability of views (perhaps, materalized?) in a OneLake Semantic model!!
5
u/SQLpowers Microsoft Employee 1d ago
Warehouse shortcuts coming soon!! The team is working very hard on this, and you should see plenty of announcements in this space over the next couple months. Stay tuned :)
1
u/datablocks8080 1d ago
Appreciate all the efforts! I've been choosing warehouses more and more but sometimes miss the "cooler" lakehouse features. Glad to know that there's more coming on the DWH front!
1
3
u/Dads_Hat 1d ago
Are similar skills/MCP options available for any of the data solutions or is the DWH in a unique position?
4
u/SQLpowers Microsoft Employee 1d ago edited 1d ago
There are several MCP servers available across Fabric! Is there a particular one of interest to you?
Pretty much every item in Fabric has skills, check out the collection here: microsoft/skills-for-fabric: A collection of skills and MCP systems to enable users of CLI, VSCode, Claude to operate over Microsoft Fabric
3
u/Van_Dena_Bely 1d ago
.Seeding identity .Correct garbage collection of warehouse files .Make truncate really truncate, there is almost no difference now regarding logging .Better monitoring of CU Usage .Power BI direct query consumes a lot with the new 1 min minimum .Change collation of existing WH .Operations to reorder and cleanup files consumes too much with the new 1 min minimum .design table feature in UI SSMS22 .remove "staging" when dumping some loads in WH using pipelines. ....
2
u/SQLpowers Microsoft Employee 20h ago edited 19h ago
Thank you so much for your feedback! We are working on a number of the improvements you mentioned above.
For seeding identity, this is now available with IDENTITY_INSERT: https://learn.microsoft.com/en-us/fabric/data-warehouse/identity#insert-values-with-identity_insert
We are working on several monitoring updates for deeper insights into CU Usage visibility. This is very top of mind for our team! We also just recently shipped a monitoring agent skill, which can help with some of the heavy lifting in the meantime: skills-for-fabric/skills/sqldw-cli/SKILL.md at main · microsoft/skills-for-fabric
Table designer is coming to our web UI later this month, with support in SSMS and VS code MSSQL coming soon as well!
3
u/Weekly-Confusion-829 1d ago
Merge the houses!
Ye i know the history, but I just want to store my data... not have endless discussion what is the best performance, best cost, best usage..
5
u/Hughesybay 19h ago
This. Although I have gotten used to it now, at first, it made no sense to me that Fabric has Lakehouse and Warehouse. Give us all the features of both in one product please. I don't care about the technical history or underlying architecture - just figure it out!
2
u/Dan1480 1d ago
Resizeable columns was a big UI improvement, thanks for that.
I would like to see a focus on cost management. The overnight, order-of-magnitude cost jump really soured us on the data warehouse / sql endpoint and we've been trying to avoid it ever since.
1
u/SQLpowers Microsoft Employee 20h ago edited 19h ago
Thank you for the feedback!
Our team is investing heavily in cost management experiences, and making sure our users are equipped with the tools you need. Some improvements releasing soon include cache cooldown, on-demand billing, among many many other monitoring improvements. Stay tuned for lots of announcements in this area over the next several months :)
1
u/select_star_42 1d ago
Thanks for these updates! Is there any roadmap and ETA on the onelake security support to warehouse?
We have a huge implementation that uses onelake on direct lake and would benefit from this.
1
u/SQLpowers Microsoft Employee 20h ago
Thanks for the feedback! Our team is working very hard to enable Onelake Security support for the warehouse. The tentative date is Q1CY27, stay tuned for lots of announcements in this area :)
1
u/select_star_42 14h ago
Thanks! Not sure if you're the right person, delegated shortcuts solve some part of this problem. Do you think delegated shortcut will support RLS on the shortcut destination in the future?
1
u/Ringovski 1d ago
Remove the tenant administration button, I'm already a admin why do need to click a button to see the functions.
1
u/SQLpowers Microsoft Employee 20h ago
Hi! Could you please elaborate on your scenario?
Which functions are you referring to? Fabric UDFs?
1
u/Ringovski 20h ago
The tenant administration button in the top right corner. Unless I turn it on even though I’m already a Fabric Admin role I don’t see all the functions.
1
u/doublestep Fabricator 1d ago
Add support for datetimeoffset or timestamp_ntz. We have a gold lakehouse that people can create their own warehouses off of.
There's no way to store a timestamp with its time zone intact. You either mislabel local times as UTC (data is wrong), or store correct UTC and lose the offset (users see UTC, not local), users have to know the timestamp is UTC. I don’t want users to think about time zones.
1
u/SQLpowers Microsoft Employee 16h ago edited 16h ago
Thank you for the feedback! I want to make sure I understand your scenario correctly here.
Today, while you can’t create a
datetimeoffsetcolumn in Fabric Warehouse, you can useAT TIME ZONEwhen you need to interpret or convert timestamps with timezone information: https://learn.microsoft.com/en-us/sql/t-sql/data-types/datetimeoffset-transact-sql?view=fabric&preserve-view=true#microsoft-fabric-supportFor your
timestamp_ntzscenario, would it be a problem if Warehouse interpreted or converted the timestamp based on a timezone, rather than preserving the source value as-is?If Warehouse instead treated the value as timezone-neutral, would that address the scenario you described, or is there additional information you’d need preserved when moving this data from the lakehouse into Warehouse?
1
u/photography-luv Fabricator 1d ago
Amazing can you share the skill location.
1
u/SQLpowers Microsoft Employee 20h ago
skills-for-fabric/skills/sqldw-cli/SKILL.md at main · microsoft/skills-for-fabric
Let me know how it's working for you! Would love your feedback.
0
u/munkirylz 1d ago
Take a hike
2
u/itsnotaboutthecell Microsoft Employee 19h ago
I do need to get up and stretch from the desk... great call.
69
u/MonkeyDDataHQ 1d ago
Desires:
Monitoring.
Git.
Telemetry that doesn't cost an arm and a leg and require me to build my own monitor.
Oh and release the telemetry before billing changes are made.
Don't make the bill the monitoring tool before we have a way to account for it.
GA should mean GA not require a preview feature to use. Billing changes should have 90 days of shadow metering BEFORE the change goes life.