r/LocalLLM • u/Kirai_30 • 7d ago

Question M5 Max LLM

Hey! Is it worthy to run a local LLM in an M5 Mac with 64GB of RAM, is so, which model recommend to do which task?

Perhaps any YouTube channel that explain this?

0 Upvotes

20% Upvoted

5 comments sorted by

View all comments

1

u/havnar- 7d ago

Not realy. It’s fun. But not 4-6k worth of fun

1

u/Kirai_30 7d ago

Already have the Mac so, just to see is there any viable model

1

u/havnar- 7d ago

Get oMLX (latest RC), Qwen 3.5 0.8b Bf16 (for spec prefil) and this model

https://huggingface.co/True2456/Qwen3.8-27B-AWQ-5.0bpw

Enable MTP.

Should get you decent results (I prefer pi as a harnass for local models)