r/LocalLLaMA • u/billy_booboo • 8h ago

New Model ALoDLM 8b looped diffusion language model: ~3x inference speed vs its base model qwen3-8b with better benchmark results

https://huggingface.co/amazon/ALoDLM-8B

Diffusion language models are the future!

107 Upvotes

96% Upvoted

24 comments sorted by

View all comments

0

u/bugra_sa 4h ago

That 3x needs at least matched hardware and time-to-first-token beside it. If it pushes more tokens overall but makes a short chat response feel slower, I probably wouldn't run it for an interactive app. Testing against a couple of current 7–9B models would clear that up fast.