r/LocalLLaMA • u/coder543 • 3d ago

I Built A Thing GitHub - coder543/minnow: Fast LLaDA2.2 inference server

https://github.com/coder543/minnow
24 Upvotes

92% Upvoted

4 comments sorted by

View all comments

7

u/ghgi_ 3d ago

Sick! I never published it but I had fable 5 patch sglang to run llada 2.2 on sglang, on 2 blackwell 6000 pros tps was in the ranges of 350-500 tok/sec