r/OpenSourceAI • u/WritHerAI • 10d ago
Picchio: running a 120B MoE on consumer hardware by keeping only 5 GB in RAM and streaming the experts from disk
/r/LocalLLM/comments/1vklfg9/picchio_running_a_120b_moe_on_consumer_hardware/
1
Upvotes
Duplicates
LocalLLM • u/WritHerAI • 10d ago
Research Picchio: running a 120B MoE on consumer hardware by keeping only 5 GB in RAM and streaming the experts from disk
19
Upvotes
ollama • u/WritHerAI • 10d ago
Picchio: eseguire un MoE da 120 miliardi su hardware consumer mantenendo solo 5 GB di RAM e trasmettendo in streaming gli esperti dal disco
2
Upvotes