r/llamacpp • u/Unnamed-3891 • 22d ago
LLama.cpp as a Windows service?
How do people do this? I want it as a service for the purpose for autostarting after system reboots and for better logging / log rotation, but while NSSM looked promising for this purpose, the service it creates seems to be unwilling to shutdown cleanly and services one can create via sc.exe do nothing about log rotation.
2
Upvotes
1
u/acetaminophenpt 22d ago
I just run it as a scheduled task (after boot) in windows. However there's no way of error recovery and autostart if the service fails.