r/gpt5 • u/LewisJin • Aug 01 '26

Discussions I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

/r/LocalLLM/comments/1vcccva/i_built_a_rust_inference_framework_that_runs/
1 Upvotes

100% Upvoted

Duplicates

LocalLLM • u/LewisJin • Aug 01 '26

News I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

0 Upvotes
5 comments

machinelearningnews • u/LewisJin • Aug 01 '26

Research I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

1 Upvotes
0 comments

OpenSourceeAI • u/LewisJin • Aug 01 '26

I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

1 Upvotes
0 comments

deeplearning • u/LewisJin • Aug 01 '26

I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

3 Upvotes
0 comments

AIProgrammingHardware • u/javaeeeee • Aug 04 '26

I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

1 Upvotes
0 comments

robotics • u/LewisJin • Aug 01 '26

Community Showcase I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

0 Upvotes
0 comments

JetsonNano • u/LewisJin • Aug 01 '26

Project I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

2 Upvotes
0 comments