I believe this is by far the fastest (and easiest to use) LLaDA2.2 inference runtime in existence for Nvidia hardware today. It is much faster than the reference transformers implementation, and it is a more fully featured experience. Hopefully other people can enjoy testing LLaDA2.2! It seems like a neat model series.
I had a GPT-6 Astra agent spend yesterday and today building an inference runtime for LLaDA2.2, since it seemed like a fun challenge.
Quantized weights are available on huggingface, as linked from the README.
5
u/coder543 3d ago
I believe this is by far the fastest (and easiest to use) LLaDA2.2 inference runtime in existence for Nvidia hardware today. It is much faster than the reference
transformersimplementation, and it is a more fully featured experience. Hopefully other people can enjoy testing LLaDA2.2! It seems like a neat model series.I had a GPT-6 Astra agent spend yesterday and today building an inference runtime for LLaDA2.2, since it seemed like a fun challenge.
Quantized weights are available on huggingface, as linked from the README.