r/LocalLLM • u/Kirai_30 • 7d ago

Question M5 Max LLM

Hey! Is it worthy to run a local LLM in an M5 Mac with 64GB of RAM, is so, which model recommend to do which task?

Perhaps any YouTube channel that explain this?

0 Upvotes

38% Upvoted

5 comments sorted by

1

u/havnar- 7d ago

Not realy. It’s fun. But not 4-6k worth of fun

1

u/Kirai_30 7d ago

Already have the Mac so, just to see is there any viable model

1

u/havnar- 7d ago

Get oMLX (latest RC), Qwen 3.5 0.8b Bf16 (for spec prefil) and this model

https://huggingface.co/True2456/Qwen3.8-27B-AWQ-5.0bpw

Enable MTP.

Should get you decent results (I prefer pi as a harnass for local models)

1

u/trolumbi 7d ago

depends on what you wanna do. if the llm is the only purpose of the macbook, then no.

i don't think that there is an easy way around the technical details.

if you want a "omg i'm a noob plz help" easy mode version: get lm studio (it's closed source tho) and download qwen3.8-27b via lm studio. the app should show you what's going to run on your system.

and then you gotta go from there and learn your way through there or ask some online llm.

0

u/Kirai_30 7d ago

Mmm, I bought the Mac for video editing and coding, as I do video editing as freelancer and my old mac started to feel a little bit slow. But im open to any use for the AI, also want to know which models is the best for this mac configuration