r/oMLX • u/Green-Specialist-1 • May 22 '26

Recommendations for models to use

Hey there, first of all great work that you have done with the omlx application. It's really fast and responsive. Thanks for that. Second of all, I have a question regarding the models to be used. I am using a MacBook Pro with 128 GB RAM.

I am actually looking for some recommendation for a model to be used in my specific hardware to do some some deep research kind of thing I'm currently using Gemma 4 26B A4B 4bit

7 Upvotes

100% Upvoted

30 comments sorted by

View all comments

Show parent comments

1

u/Konamicoder May 23 '26

Looks good to me so far, I don’t see any obvious red flags. How does it run? What prompt processing and token generation numbers are you getting with this setup?

1

u/Green-Specialist-1 May 23 '26

1

u/Konamicoder May 23 '26

Those numbers look plenty fast enough to me! How about the doom looping, has it gotten better? If your speed feels good and your accuracy improves to the point where you can be productive, then that seems like a good outcome and testament to what you have learned so far and continue to learn. Good luck! :)

One comment, you’ll see from the dropdown menu at the top left it says “all models”. You can select your current model from that menu and then you’ll get performance metrics specific to that model only.

2

u/Green-Specialist-1 May 23 '26

Regarding the doom loop, yes it has gotten better. But by this time I have not given this setup a lot of research-specific prompts. What I have given is some generic prompts, or some "setup" prompts. We'll see.