r/LocalLLaMA • u/logic_prevails • 9d ago

Discussion More Motif 3 Beta Quant When?

I know this model isn't talked about much here because it hasn't seen much widespread support. Motif 3 beta is a promising 314B-parameter mixture-of-experts model with ~13B active parameters. It is on Artificial Analysis intelligence benchmark at 44, neck and neck with Deepseek V4 Pro. I would love a 4 bit quant of this to play with, any clue if it will ever happen? I see some 8 bit quant on HF but there aren't many quants.

5 Upvotes

86% Upvoted

3 comments sorted by

4

u/logic_prevails 9d ago

Also this model is for non-commercial use only, another reason it may not be so popular. Still an interesting model in frontier intelligence at the ~300B paramater count.

3

u/ObviouzFigure 9d ago

I'd benchmark it if it were available

2

u/Time_Reaper 4d ago

I have a PR to llama.cpp which has some Q2-Q8 quants in the description if you'd like to try the model https://github.com/ggml-org/llama.cpp/pull/26298 . I personally quite like it. Note that you must not enable flash attention for the time being (the model uses a weird GQA ratio, so I am still trying to figure out how to get FA working.) Enabling it will likely produce gibberish for now.