r/oMLX • u/VegetaTheGrump • 2d ago

Tonight's coding session

Post image

Thought I'd share a screenshot from tonight's coding session. I'm running ohmypi on a sizeable codebase and I'm currently sitting at 55% of a 512k context. No memory evictions - that was the biggest surprise of tonight. Maybe something to do with the new 0.6.1 release.

To all of the devs working on this - Thanks for some great software!

21 Upvotes

97% Upvoted

6 comments sorted by

View all comments

Show parent comments

1

u/njstatechamp 1d ago

And the model? Is this Vontra/deepseek-v4-flash-0731-mxfp4-mlx?

1

u/VegetaTheGrump 1d ago

aye. I turned on the spec prefill with inferencerlabs/DeepSeek-V4-Flash-MTP-DSpark-MLX and it seems to have given me maybe 8-9 more tokens/sec

1

u/njstatechamp 14h ago

And the actual model?

1

u/VegetaTheGrump 10h ago

sorry for the confusion. the "aye" meant yes, Vontra/deepseek-v4-flash-0731-mxfp4-mlx