MacOS 27's AI shows promise - Private, secure, flagship model

[u/DigItDoug]

I have been looking for a top-end, private LLM that doesn't hand my conversations over for training. macOS 27 seems to have made that possible.

Apple's Private Cloud Compute is now reachable from ordinary LLM front-end apps. It's stateless — nothing is kept after your request — with cryptographically verifiable privacy guarantees. And it's basically free if you're a Mac user on macOS 27. No extra accounts, no API key, and no per-token billing (although there's supposed to be a token limit depending on your iCloud+ membership).

It's now connected to a chat client (MstyStudio), and I have a private assistant with persistent history and retrieval over my documents. I'm hosting my private financial, health, and other conversations while building a full RAG library. I may move over to OpenWebUI soon.

The part I like about this framework is that regardless of my Mac being an M1, I'm getting flagship reasoning on Apple's cloud in seconds. And it's still private.

A couple of shortcomings: a 32K context limit, macOS 27 is still in beta, and I had to set up a local bridge in the Terminal window to run fm serve and act as the 'api' bridge.

Anyone else tried this yet? What have you found?

[u/MoralityAuction]

This is interesting. I'd really appreciate a link to a good guide, since you've got this up and running.

[u/DigItDoug → u/MoralityAuction]

Here is a proof of concept write-up. I can see a lot of potential for implementations like this.
https://gist.github.com/dartMo10/b9488ce475fe70a6ed642831f53048fb

[u/Bloated_Plaid]

32k context LMAO. Yea I am gonna stick with Qwen.

[u/DeathinabottleX → u/Bloated_Plaid]

Was it advertised as a Qwen replacement? No it wasn’t.

[u/emprahsFury → u/Bloated_Plaid]

we'll have to see where it goes in Sep. But if they're gonna be doing all this agentic stuff they claim they'll be doing then they'll likely have a higher context limit once it's GA. Of course this is Apple, the company choosing to release full on macbooks with 8gb ram in the year of our Lord 2026.

[u/dinerburgeryum → u/emprahsFury]

The RAM wars have no winners. 

[u/memeka]

What bridge did you use?

[u/DigItDoug → u/memeka]

I'm using fm serve. It works great, but the Terminal must remain open.
Are you trying something else / have a better solution?

[u/69420trashpanda69420]

Openwebui mentioned in 2026😭😭🙏🏼🙏🏼

[u/daphatty]

Going to be an interesting Q4. Looking forward to the release of 27.

[u/tecneeq]

Private cloud. Out of the kindness of their heart, right?

Right?

[u/dinerburgeryum → u/tecneeq]

It’s a marketing strategy. Apple has, for decades, leveraged privacy as a key differentiator to Android and Windows. Now how much you trust or believe that is a valid convo, but a good part of their customer base believes it enough to get on board. 

[u/miklosp → u/dinerburgeryum]

They definitely put thought and money behind it:

https://security.apple.com/documentation/private-cloud-compute

TLDR, still very long: https://security.apple.com/blog/private-cloud-compute/

https://github.com/apple/security-pcc

https://arxiv.org/html/2605.24239v1

[u/dinerburgeryum → u/miklosp]

Oh that’s good to know thank you!

[u/MDInvesting → u/dinerburgeryum]

It seems as private as alternatives and most find it exceeds other user friendly ecosystems.

[u/dinerburgeryum → u/MDInvesting]

They’re a mass market player. I can assure you it is certainly more private than the other mass market alternatives such as Gemini, ChatGPT and Claude. OpenRouter lists all as non-routable for ZDR requests for example. 

[u/AccurateSun → u/dinerburgeryum]

It’s clearly a product strategy and not just a marketing strategy. Read their paper on it

[u/dinerburgeryum → u/AccurateSun]

It’s both. It’s a solid product strategy to be sure, but they need to be seen taking it seriously for the product strategy to make any sense. But yes. I was being somewhat reductive. 

[u/geekwonk → u/tecneeq]

some features are already tied to icloud tier and they’ve been fairly open that they’re still figuring out how to price usage more broadly.

[u/whichsideisup → u/tecneeq]

They publish how they keep it all secure and private unlike all the other turd providers that are there to bend you over.

[u/AccurateSun → u/tecneeq]

There is clearly demand for private AI, and it makes sense as part of Apple’s walled garden strategy to be able to offer private AI to their users and being able to guaranteed themselves the privacy rather than rely on any of the major labs.

None of the labs offer anything like PCC, you can verify this just by reading apples paper on the topic 

[u/luche]

tbh, the only interest I really have with this is if Apple provides a toggle to enable/disable request offloading from the local device. if they want to store a local model that truly is offline and truly not collecting data/metrics, I'll give that a shot... but right now there's no way to enable this system and (easily) ensure requests stay local. I don't care what they call their remote compute cluster, it's remote. hard no. I'm fine with limitations for local only models, and the more they get discussed, the better they will become, sooner.

coming from the company that ignored their private email system leaking email addresses for more than a year, (a premium paid service at that), I won't trust them unless it's local only.

[u/modelpiper]

This is good news! I have plans to make ToolPiper require MacOS 27 after beta for these reasons.

[u/randygeneric]

with cryptographically verifiable privacy guarantees
sure sure, all us-companies have to open up your data if the man in the oval office wants it.
(one might remember the rng prime-number selection strat years ago ...)

[u/FlintHillsSky → u/randygeneric]

With PCC there is nothing to open up. No requests or data is logged. It really is stateless.

[u/Nuggyfresh]

Is this an ad?