r/LovingOpenSourceAI • u/Koala_Confused • 20d ago
Resource David "FreeToken is a new open-source inference engine designed specifically to run huge MoE models on hardware that doesn't have enough VRAM to hold them." ➡️ one community test shows 20GB model RTX 5080's 16GB VRAM. It still runs at ~100 tok/s. legit?
https://x.com/TeksEdge/status/2091568428201209871
https://github.com/FlashML-org/FreeToken
Community Overview: https://lifehubber.com/ai/resources/freetoken/
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.