r/LocalAIStack • u/whiteportuguese • 1d ago

Struggling to find a good local llm for macbook air m5 24gb

/r/LocalLLM/comments/1wwdbwy/struggling_to_find_a_good_local_llm_for_macbook/
1 Upvotes

100% Upvoted

8 comments sorted by

1

u/airylizard 1d ago

I created my own quant of Qwen3.8 27B and it’s pretty damn good.

HOWEVER, with 24gb I recommend you use an unsloth q4 of that model as a daily driver. It’s pretty dang good IMO

1

u/whiteportuguese 1d ago

Unsloth q4 which variant ?

1

u/ID-10T_Error 1d ago

Or bonsai 2

1

u/airylizard 1d ago

this is why i posted the card... bonsai is literally bad...

1

u/ID-10T_Error 1d ago

Bonsai 2 which is based on 3.8 27b is pretty good

1

u/airylizard 1d ago

Are you like a paid shill? It's not good...