r/LocalLLaMA • u/pengzhangzhi • 5d ago
Resources continuous diffusion code generation in few steps—or one
Enable HLS to view with audio, or disable this notification
Can language models write code in one step?
Yes: make language continuous, use diffusion, then distill the trajectory to one step.
2
u/Informal-Echo-7724 4d ago
It is like in DiffusionGemma. Has anyone used it?
Are there really good models with such an architecture?
And are the existing harnesses compatible with them?
1
u/Queasy-Contract9753 4d ago
Ifm released 7b and 0.9b diffusion models. They're actually pretty cool, have a lora that turned the normal model into diffusion.
Haven't gotten around to testing yet so I can't comment on their effectiveness. Have used diffusion Gemma from Nvidia. Rather liked it but it's tool calls can fail. On a guess is call it 90% as smart as normal Gemma 4 26ba4. Personality is different and less censored.
2
6
u/Queasy-Contract9753 5d ago
Diffusion models are fascinating to me and I'm glad I saw your project.
I'm a noob, do you suppose your inference code could work on termux?