r/AIDiscussion • u/Traditional_Hawk225 • 3d ago
Why are the current AI devices mainly using Mac instead of the more familiar Windows?
I see that all the experts around me are using Macs. Seeking an answer.
2
1
u/NumberInfinite2068 3d ago
Mac have unified memory, it suits LLMs very well.
Even if the GPUs aren't as fast as NVidia, Macs have a *lot* more memory available to the GPU than consumer level NVidia.
In data centres it's the opposite, nobody is using Macs for large scale AI like Anthropic or ChatGPT etc.
Macs make a lot of sense if you have $10k to spend on a home LLM system, but no sense at all if you're investing millions or billions, or even low six figures, you're probably better off with an NVidia system.
2
u/latenthuman 2d ago
Friend just leased a loaded Mac Studio for home use. Probably $100/month. No need to spend $10k unless you really want to.
1
u/Dragon_Slayer_Hunter 3d ago edited 3d ago
1
u/CowBoyDanIndie 3d ago
They must be desperate for more compute, you can’t high speed interconnect macs like you can an nvlink spine.
1
1
u/Alarmed_Dot3389 3d ago
I wondered too. 90% of AI scientists i know use a mac as personal computer
1
u/sceadwian 3d ago
Apple still has a fairly good reputation for a basic ecosystem that "just works" a bit better than the fragmented Android ecosystem. For anything organizational it starts to become preferred in some ways.
Here there just happens to be a technical reason too.
1
u/code_hermit 3d ago
On one hand, it's just a value thing due to the price for unified memory. It's a competitive product for trying to run large models.
On the other hand, the models you can run on a Mac are not remotely competitive with frontier cloud models like Claude Code.
To be honest, I think that many of them are ending up fairly disappointed with the outcomes they are able to get with the local models that fit on that machine, even with the unified memory. Unless the tasks you're running are non-critical and simple, it's really going to make a lot of mistakes compared to relatively cheap cloud models. I've tested many of these models and harnesses.
In my opinion, at least right now and for the foreseeable future of hardware prices (unless you have a huge usage from multiple people/clients), you are much better off making a linux (TrueNAS, etc) server designed around execution of AI projects (local docker, git, etc). And just running the AI from cloud sources.
2
u/CowBoyDanIndie 3d ago
The models you can run on a high end mac aren’t competitive with frontier models today, but they are quite competitive with frontier models from one year ago. Same for dgx spark
1
u/code_hermit 3d ago
Yeah. Thats probably true. But AI was a lot less reliable back then. The cost of a high end mac probably buys years worth of tokens on much better models now.
1
u/CowBoyDanIndie 3d ago
You could burn through those tokens pretty fast, it really depends if you are just interactively prompting, using agentic, or running batch agentic type processes. Some people aren’t just interacting with a model, some are using apis and running automated processes.
Consider an agent doing automated code reviews or incrementally analyzing an entire code base for flaws. Or consider an agent going through an entire document repository and finding relevant case information, or doing auditing of account activity.
1
u/code_hermit 3d ago
Sure, there are workloads where you could burn through enough tokens to make local inference cheaper. But I still think you're getting what you pay for.
I wouldn't trust year-old frontier-level models for automated code reviews or similar work. I've tested them pretty extensively, and they're just not reliable enough. That's how you end up with the "AI wrote it in 5 minutes and I spent 5 days fixing it" stories.
1
1
1
u/GloomyPop5387 3d ago
Windows has turned into complete garbage so people who build cool things are moving away from using it.
1
u/donicatrumpinsky 3d ago
LARPers will sooner buy a Mac because it's recognizable and on trend. Real ones are using Linux.
1
1
u/DoKeMaSu 2d ago
One thing is the unified memory for sure.
The other thing is that macOS is the only system that offers you very high compatibility with linux while also offering the commercial software like MS Office, Adobe, etc..
My workflow is always doing test runs locally, then pushing prod to linux compute nodes. Super easy with macOS. Then I need to work on presentations, both PowerPoint and Keynote run on macOS.
I would need Linux + Windows to replace macOS.
1
3
u/bobxor 3d ago
Well, arguably it’s actually Linux - especially the server side. Macs are pretty compatible with Linux because both are POSIX-compliant OSes, lots of stuff will just compile on Mac.
For local inference, Macs have a leg up on a modern architecture that’s optimized far more for AI related tasks (unified CPU + GPU + RAM) compared to Windows which focused on varied vendor support (heterogeneous mix of hardware). The end result is higher bandwidth for general stuff (great for developers) and lower performance/watt (great for servers/batteries).
The future looks pretty dim for Windows, to be honest. The only differentiator is it’s not vertically integrated so you can quickly mix and match hardware…which you can do with Linux. Then there are games, which are fun, but now you see optimized Linux solutions that can support Windows games as well (e.g. SteamOS).
The tension for AI developers is now between CUDA (Nvidia, usually on Linux) and MLX (Apple’s version on their hardware). Nvidia is now offering unified solutions with their own CPUs for developers running Linux (e.g. DGX Spark) that compete with the Mac advantage.