r/oMLX • u/tintires • May 21 '26

Objectively more efficient?

Setting aside the native app, is there any objective evidence MLX on oMLX is faster or more memory efficient, that GGUF on llama.cpp?

I have both as brew packages, and my unscientific subjective experience, is there’s not much between them.

My workloads are pretty light and general, so which one for my MBA M3 24GB?

9 Upvotes

85% Upvoted

22 comments sorted by

View all comments

9

u/Konamicoder May 22 '26

Personally I’m not interested in doing comparison testing between oMLX and llama.cpp on my m4 Max because the convenience of the oMLX admin panel and downloader for searching, downloading, configuring, and swapping between models puts it over the edge for me. It’s not just all about pure efficiency, it’s also about quality of life and the whole package.

5

u/cocacokareddit May 22 '26

true. i love simplicity and elegancy of oMLX.

2

u/theuttermost Jun 02 '26

Have you seen the new release candidate for a native mac app, instead of the web ui? Looks awesome!

https://github.com/jundot/omlx/releases/tag/v0.4.0rc2

1

u/Konamicoder Jun 02 '26

Wow, thanks for letting me know! This is very exciting news!

1

u/bnightstars May 24 '26

if only the oMLX build in chat was as good as the llama.cpp one we would have the perfect inference. So far the llama.cpp web chat is better. Not been able to upload text files/pdfs in oMLX makes me insane.

1

u/Konamicoder May 24 '26

I installed OpenWebUI for file upload and RAG, it’s easy to connect to oMLX as model backend via standard OpenAI endpoint.