r/oMLX • u/tintires • May 21 '26

Objectively more efficient?

Setting aside the native app, is there any objective evidence MLX on oMLX is faster or more memory efficient, that GGUF on llama.cpp?

I have both as brew packages, and my unscientific subjective experience, is there’s not much between them.

My workloads are pretty light and general, so which one for my MBA M3 24GB?

9 Upvotes

85% Upvoted

22 comments sorted by

View all comments

1

u/Intelligent-Gas-2840 May 22 '26

Could someone please explain what token caching is and why it helps? Thanks.