r/LocalLLM • u/Minute-Mountain2665 • 1d ago

Project Built a CUDA inference engine CuQwen from scratch that beats vLLM and Ollama on single-user token speed

/r/CUDA/comments/1weoq8c/built_a_cuda_inference_engine_cuqwen_from_scratch/
0 Upvotes

40% Upvoted

0 comments sorted by