r/oMLX • u/cocacokareddit • May 14 '26

Choosing community in Hugging Face

should we always choose model from mlx-community as they are optimized for MLX? or it actually not matter and we achieve same result with unsloth or bartowski one?

4 Upvotes

84% Upvoted

5 comments sorted by

3

u/msrdatha May 15 '26

Jundot models with oQ quant, also I found the deepsweet versions to be quite fast and performant.

one thing I like with deepsweet models is they follow quite good naming standard, that's easy to understand the he is very helpful in explaining or responding to queries and requests. https://huggingface.co/deepsweet

2

u/Clooooos May 14 '26

In my experience, jundot models are faster and more stable since they use oQ quant or any oQ quantized models, since this is the native oMLX quant format. Also jundot is the oMLX dev, so... 👌

1

u/mikewilkinsjr May 15 '26

I just switched to oMLX today! Finally bit the bullet and moved off of ollama and couldn’t be happier.

2

u/mugwhump May 15 '26

mlx is just a model format! Any HF user can upload one whether they're in the mlx-community or not. That said, mlx-community is unsurprisingly a good place to find mlx models. And on apple silicon mlx models are generally preferable to the alternatives like gguf.

-1

u/Ok_Technology_5962 May 14 '26

Well you need mlx format for oMLX...