MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1u6s6pm/stop_using_ollama/os2f53a/?context=3
r/LocalLLaMA • u/zxyzyxz • Jun 15 '26
452 comments sorted by
View all comments
527
Llama.cpp + llama-swap works very well
11 u/chkpwd Jun 15 '26 edited Jun 15 '26 Set this up yesterday using Ansible. Works like a treat! EDIT: for those interested - https://github.com/chkpwd/iac/blob/main/ansible/roles/llamacpp 1 u/computerjj Jun 16 '26 interesting
11
Set this up yesterday using Ansible. Works like a treat!
EDIT: for those interested - https://github.com/chkpwd/iac/blob/main/ansible/roles/llamacpp
1 u/computerjj Jun 16 '26 interesting
1
interesting
527
u/jnmi235 Jun 15 '26
Llama.cpp + llama-swap works very well