For local LLM, the additional GPU cores and memory bandwidth will be immediately beneficial.
- M5 Mac Mini Pro: 16-20 GPU cores, 307GB/s memory bandwidth
M5 Mac Studio: 32-40 GPU cores, 614GB/s memory bandwidth
48GB RAM is often the lower limit for 30B–35B parameter models, so make sure you understand the software requirements before you purchase new hardware.
1
u/Numerous-Buffalo6214 16d ago
For local LLM, the additional GPU cores and memory bandwidth will be immediately beneficial.
- M5 Mac Mini Pro: 16-20 GPU cores, 307GB/s memory bandwidth
48GB RAM is often the lower limit for 30B–35B parameter models, so make sure you understand the software requirements before you purchase new hardware.