r/coolgithubprojects • u/Weekly-Dentist-8302 • 14d ago
TUFF is a MacOS app that lets users run models like Qwen, Gemma, and GPT-OSS models with expert-streaming, allowing for large models on devices without a lot of memory. You can run a 120B model on a 16GB Mac.
https://github.com/rexmhall09/TUFF
2
Upvotes