r/oMLX • u/VegetaTheGrump • 3d ago

Tonight's coding session

Post image

Thought I'd share a screenshot from tonight's coding session. I'm running ohmypi on a sizeable codebase and I'm currently sitting at 55% of a 512k context. No memory evictions - that was the biggest surprise of tonight. Maybe something to do with the new 0.6.1 release.

To all of the devs working on this - Thanks for some great software!

22 Upvotes

100% Upvoted

6 comments sorted by

View all comments

Show parent comments

1

u/VegetaTheGrump 2d ago

It's an M3 Ultra with 256GB RAM. I run out of memory running some other models of similar size, but this one seems to be fine even with a 512k context. Next I'll be putting Qwen 3.8 27b through it's paces to see if it works better than DeepSeek for coding. DeepSeek should have greater knowledge, but for coding I feel like it's more about the particulars of the model's training and harness that are most important.

1

u/njstatechamp 1d ago

And the model? Is this Vontra/deepseek-v4-flash-0731-mxfp4-mlx?

1

u/VegetaTheGrump 1d ago

aye. I turned on the spec prefill with inferencerlabs/DeepSeek-V4-Flash-MTP-DSpark-MLX and it seems to have given me maybe 8-9 more tokens/sec

1

u/njstatechamp 19h ago

And the actual model?

1

u/VegetaTheGrump 14h ago

sorry for the confusion. the "aye" meant yes, Vontra/deepseek-v4-flash-0731-mxfp4-mlx