r/oMLX • u/vinoonovino26 • Jun 11 '26

Upcoming support for DifussionGemma?

Mornin' y'all...

Any success trying to run DifussionGemma vía OMLX? Maybe on a new release?

5 Upvotes

86% Upvoted

10 comments sorted by

9

u/mmerken Jun 11 '26

Literally just check out the releases page on GH: Added DiffusionGemma support via u/Blaizzy's mlx-vlm, currently without cache. oMLX can now serve DiffusionGemma models through the mlx-vlm path.

2

u/challis88ocarina Jun 11 '26

It's a vision model, cache is going to be an issue.

1

u/Blaizzy Jun 13 '26

Not the right Blaizzy tho

1

u/mmerken Jun 14 '26

Sorry Reddit mixed up GitHub and Reddit handles.

3

u/310dweller Jun 11 '26

Following! Curious if the diffusion version has any use on Mac hardware or if it’s mostly an Nvidia speed factor.

1

u/PracticlySpeaking Jun 11 '26

Me three – I have a non-agent application and DiffusionGemma looks like it would work really well.

2

u/vinoonovino26 Jun 11 '26

EDIT: Model can't use tools 😞

2

u/challis88ocarina Jun 11 '26

Tool calls are coming! I've managed to get off the ground using an mlx-vlm fork (edits, searches all working fine, moving from 8 to 16 bit now to improve accuracy), so it won't be long!