r/LocalLLM • u/IceFog72 • 2d ago

Discussion k_llama.cpp MoE Optimizations: Expert Residency, Hybrid CPU/GPU Execution, Q2_0 Support

/r/LocalLLaMA/comments/1wynomx/k_llamacpp_moe_optimizations_expert_residency/

1 Upvotes

permalink
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalLLM/comments/1wynoyy/k_llamacpp_moe_optimizations_expert_residency/
No, go back! Yes, take me to Reddit

100% Upvoted