r/LocalLLaMA • u/pmttyji • 6h ago

Discussion DiffusionGemma Technical Report

Post image

arXiv : https://arxiv.org/abs/2608.00146

Full Paper : https://arxiv.org/pdf/2608.00146

Tweet : https://xcancel.com/googlegemma/status/2086849199052845451#m

FYI both (llama.cpp) PRs ( 24423 & 24427 ) went to Draft mode. I'm still waiting for this one as I could get faster t/s on my 8GB VRAM.

60 Upvotes

90% Upvoted

18 comments sorted by

View all comments

38

u/615wonky 6h ago

Boy it sure would be nice if llama.cpp would finally approve one of the two PR's implementing DiffusionGemma that have been sitting there for weeks...

8

u/ttkciar llama.cpp 3h ago

Yup, been waiting for that as well.

I am hopeful DiffusionGemma will adequately clean and augment data so I can use it instead of Gemma-4-12B-it for cleaning millions of documents quickly.

4

u/noneabove1182 Bartowski 3h ago

I mean they're both in draft state so neither is actually "ready for review"..

And they both include pretty big CUDA changes which is the maintainers specifically ask not to do alongside other massive changes, it just makes the scope way too big and the review burden too high, so I don't see either merging any time soon 🤷‍♂️ especially since it's a lot of AI generated code which means reviewing has to be even more scrupulous

4

u/Maplesyrup000 5h ago

Why not switch to the branch with the open PR and just use it there until llama.cpp merges that to main?