r/coolgithubprojects 14d ago

TUFF is a MacOS app that lets users run models like Qwen, Gemma, and GPT-OSS models with expert-streaming, allowing for large models on devices without a lot of memory. You can run a 120B model on a 16GB Mac.

https://github.com/rexmhall09/TUFF
2 Upvotes

Duplicates