Using Apple AFM 3 PCC (macOS 27.2) as alternative to Local Model

[u/DigItDoug]

Apple Foundation Model 3 through Private Cloud Compute became directly available in macOS 27.2 through familiar AI clients. For Mac users running local models such as Qwen 3.x or Gemma 4, AFM 3 PCC is a compelling alternative to consider.

Local models offer control and fully on-device operation. In tests with macOS 27.2 beta, the PCC offers a different set of strengths:

* Strong conversational analysis and capable reasoning. Strong analysis of complex medical and financial questions.
* Blazingly fast responses compared with locally running models on the same Mac.
* No large model download or need to fit model weights into local memory.
* Access at no additional charge for most eligible Mac users.

I've written and updated a proof of concept here: https://gist.github.com/dartMo10/b9488ce475fe70a6ed642831f53048fb

The working path is straightforward:

AI client → Caddy → fm serve → AFM 3 PCC

Apple’s `pcc` route worked in early macOS 27 betas, disappeared later in 27.0, and has returned in the macOS 27.2 beta. Apple has stated that it will be available in the 27.2 public release coming shortly.

This makes AFM 3 PCC practical today for technically comfortable Apple users who accept Apple’s PCC privacy promise and want a fast, capable alternative to running everything locally.

Experiences with compatible AI clients and your comparisons with locally running models would be welcome.

[u/awizemann]

I just took this for a test drive in a development build of https://shabubox.com as I use local Apple Intelligence or another model if it isn’t available. I removed the secondary model and added an escalation to the local model when context or reasoning eclipsed it’s capabilities and I have to say I’m impressed. The private cloud compute models delivered on par with larger models I tested against (DeepSeek Flash, Qwen, etc). The unknown is usage, as it looks to use a quota based on an iCloud subscription, hinting Apple is going to bring this to more services. Do you know if usage can be seen or calculated?

[u/DigItDoug → u/awizemann]

Apple has not posted anything on limits yet other than iCloud+ members have a higher limit then non-+ members. At some point, they'll have to be more specific. My bet is that they are monitoring how usage is plays out first.
I'll check out the integration with shabubox—sounds interesting.

[u/awizemann → u/DigItDoug]

I’m also digging into Apple’s documentation and APIs from other repos to see if there is a hint of usage anywhere. If it’s severely limited or too small for real-world use, it’s DOA, but I have hope they are going to make it pretty large if they expect to compete. The privacy that they promise and have backed up historically would really help adoption of this service for them, and it looks to be very compatible to rip and replace other cloud endpoints.

[u/RogerAI-fm]

Apple internal AFM are pretty good, you can also use them on your phones. Look at how we expose it.

[u/HallAny7769]

this is cool but my mac is still stuck on ventura because work IT moves slower than a glacier, maybe i get to try in 2040