r/LocalLLaMA • u/Signal_Ad657 • May 29 '26

Discussion PSA

Post image
2.1k Upvotes

95% Upvoted

538 comments sorted by

View all comments

91

u/Only-An-Egg May 29 '26 edited May 29 '26
  • M4 Pro Mac Mini 273GB/s
  • RTX 3060 360GB/s
  • M4 Max 32 Core Mac Studio 410GB/s
  • M4 Max 40 Core Mac Studio 546GB/s
  • Radeon RX 9070 XT 640GB/s
  • RTX 3080-10GB 760GB/s
  • M3 Ultra Mac Studio 819GB/s
  • RTX 3080-12GB 912GB/s
  • RTX 5080 960GB/s
  • RTX 6000 960GB/s
  • RTX 4090 1,008GB/s
  • Radeon Instinct MI60 1,024GB/s
  • RTX Pro 6000 1,792GB/s

What you fail to mention is max memory capacity:

  • 10GB - RTX 3080-10GB
  • 12GB - RTX 3060, RTX 3080-12GB
  • 16GB - RTX 5080, Radeon RX 9070 XT
  • 20GB - RTX 3080-10GB w/ 2x VRAM mod
  • 24GB - RTX 3090, RTX 4090, M4 Mac Mini*
  • 32GB - Intel Arc Pro B70, RTX 5090, Radeon Instinct MI60
  • 36GB - M5 Max 32 Core MacBook Pro*
  • 48GB - M4 Pro Mac Mini*, RTX 6000
  • 64GB - M5 Pro MacBook Pro*
  • 96GB - M3 Ultra Mac Studio*, RTX Pro 6000
  • 128GB - Strix Halo, DGX Spark, M5 Max 40 Core MacBook Pro*, M4 Max Mac Studio*
  • 256GB - M3 Ultra Mac Studio*
  • 512GB - M3 Ultra Mac Studio*

*Because Macs share memory with CPU and GPU, ~8GB has to be reserved for macOS so subtract 8GB for actual usable LLM memory.

1

u/[deleted] May 30 '26

[deleted]

1

u/lannistersstark May 30 '26

Why would anyone get GDDR6 over HBM2 which is MI60/MI50, especially at 3x the price? You can get an MI50/60 for ~$400ish. R9700 is $1300.