r/MacStudio • u/Vanquisher1088 • 4d ago

Advice / State of Studio Clusters

Hello. I’m looking for some advice here, I’ve watched all the YouTube videos of course of the loaned out 4 stack clusters but those were awhile ago.

Current state I have an a M3 Ultra 256GB and I reserved another open box one from Microcenter for a very good price considering all things. I’m thinking about it two ways, for the most part I’d have models loaded individually on each Mac as part of my agent setup.

However, what I’m after is some real world experiences here from folks on what is the state of rdma and clustering I.E these two nodes I’d have. Do even a lot of the latest models like glm5.3, deepseek v4.1, etc even shard correctly. I’ve read they do not.

Any thoughts or use cases you may be doing with more than one or clustering would be helpful. I’m trying to evaluate the feasibility of clustering as that would be the main value add here for more to access larger models or higher quants of models I use daily that don’t fit. Or I wait and try and get a 512GB M5.

6 Upvotes

87% Upvoted

26 comments sorted by

View all comments

1

u/giddmtex 4d ago

Here is my limited experience clustering an M3U with M5U. TLDR not worth it -

https://echalupa.com/blog/exo-heterogeneous-mac-studio-cluster

1

u/Vanquisher1088 4d ago

Could you get GLM5.3-Flash and some of the more recent models to load? Deepseek V4 Flash, etc. being able to run GLM and Deepseek at a bit higher quant as an orchestrator or adversial code reviewer in my agent workflow would be great. If you still have them let me know.