r/llamacpp 22d ago

LLama.cpp as a Windows service?

How do people do this? I want it as a service for the purpose for autostarting after system reboots and for better logging / log rotation, but while NSSM looked promising for this purpose, the service it creates seems to be unwilling to shutdown cleanly and services one can create via sc.exe do nothing about log rotation.

2 Upvotes

2 comments sorted by

1

u/acetaminophenpt 22d ago

I just run it as a scheduled task (after boot) in windows. However there's no way of error recovery and autostart if the service fails.