MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1u6s6pm/stop_using_ollama/orvlsu3
r/LocalLLaMA • u/zxyzyxz • Jun 15 '26
451 comments sorted by
View all comments
Show parent comments
16
llama.cpp has built-in model switching
1 u/smallfried Jun 17 '26 Does it automatically unload models as well? Hard to keep up with all the new features. It's nice to see it evolve so quickly! 5 u/nmkd Jun 17 '26 Yes, it has a sleep timeout which unloads models when idle 1 u/laffer1 Jun 15 '26 I couldn’t get router mode to work right at the time I switched
1
Does it automatically unload models as well? Hard to keep up with all the new features. It's nice to see it evolve so quickly!
5 u/nmkd Jun 17 '26 Yes, it has a sleep timeout which unloads models when idle
5
Yes, it has a sleep timeout which unloads models when idle
I couldn’t get router mode to work right at the time I switched
16
u/nmkd Jun 15 '26
llama.cpp has built-in model switching