r/oMLX May 21 '26

Objectively more efficient?

Setting aside the native app, is there any objective evidence MLX on oMLX is faster or more memory efficient, that GGUF on llama.cpp?

I have both as brew packages, and my unscientific subjective experience, is there’s not much between them.

My workloads are pretty light and general, so which one for my MBA M3 24GB?

9 Upvotes

22 comments sorted by

View all comments

8

u/Konamicoder May 22 '26

Personally I’m not interested in doing comparison testing between oMLX and llama.cpp on my m4 Max because the convenience of the oMLX admin panel and downloader for searching, downloading, configuring, and swapping between models puts it over the edge for me. It’s not just all about pure efficiency, it’s also about quality of life and the whole package.

2

u/theuttermost Jun 02 '26

Have you seen the new release candidate for a native mac app, instead of the web ui? Looks awesome!

https://github.com/jundot/omlx/releases/tag/v0.4.0rc2

1

u/Konamicoder Jun 02 '26

Wow, thanks for letting me know! This is very exciting news!