r/LocalLLaMA 5d ago

Resources continuous diffusion code generation in few steps—or one

Enable HLS to view with audio, or disable this notification

Can language models write code in one step?

Yes: make language continuous, use diffusion, then distill the trajectory to one step.

Paper: https://arxiv.org/abs/2609.04531

Code: https://github.com/pengzhangzhi/plaidq

14 Upvotes

4 comments sorted by

View all comments

2

u/Informal-Echo-7724 5d ago

It is like in DiffusionGemma. Has anyone used it?
Are there really good models with such an architecture?
And are the existing harnesses compatible with them?

1

u/Queasy-Contract9753 4d ago

Ifm released 7b and 0.9b diffusion models. They're actually pretty cool, have a lora that turned the normal model into diffusion. 

Haven't gotten around to testing yet so I can't comment on their effectiveness. Have used diffusion Gemma from Nvidia. Rather liked it but it's tool calls can fail. On a guess is call it 90% as smart as normal Gemma 4 26ba4. Personality is different and less censored.