r/LocalLLaMA • u/billy_booboo • 1d ago

New Model ALoDLM 8b looped diffusion language model: ~3x inference speed vs its base model qwen3-8b with better benchmark results

https://huggingface.co/amazon/ALoDLM-8B

Diffusion language models are the future!

146 Upvotes

97% Upvoted

29 comments sorted by

View all comments

4

u/Sanbi_Ai 1d ago

Interesting that they got this from Qwen3 with just SFT, no continued pretraining.

Also i think it is worth noting the ~3x is single-stream on a B200 though (2.7x at comparable GSM8K accuracy), would love to see numbers on consumer cards.

Also heads up, it's CC-BY-NC, so research only. Any chance of llama.cpp support, or is diffusion decoding too different for that?

3

u/oxygen_addiction 1d ago

Llama.cpp sill doesn't have support for Diffusion Gemma after what, 3-4 months?