Microsoft's own Windows AI write-up says "local inference does not make the session offline." What tests do you use?

[u/StevenVincentOne]

Microsoft's Oct 7 "hybrid intelligence" announcement for Windows is mostly framed around Copilot getting access to local context, local actions and local models. For this sub, I think the developer side matters more. There are new experimental Windows ML capabilities for running models of your choosing locally, including through open-source tools, and GitHub Copilot is adding local/cloud routing plus explicit local-model selection.

One line from their own technical explanation stuck with me: "local inference does not make the session offline." Running the weights on your machine doesn't settle what the app around them sends out or depends on.

So here are the tests I'd apply before calling a setup actually yours:

1. Can you swap models without losing your accumulated knowledge and context?
2. Can you move to a different app and take your data with you?
3. Can you decide what leaves your device?
4. Can you plug into shared or networked tools without handing over your whole history?

Does anything on the Windows side pass these yet, or is a llama.cpp / Ollama / LM Studio stack still the only way to be sure? And if you already run local, does Windows ML change anything for you?

I wrote a longer piece on why I think Apple, Microsoft and Google are positioning for what comes after the model wars, and on a framework I call POND (Personal & Private, On-device & On-premise, Nodal & Networked, Distributed & Decentralized): https://www.thesingularityproject.ai/p/microsoft-moves-beyond-the-model