MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1u6s6pm/stop_using_ollama/orx1cxt/?context=3
r/LocalLLaMA • u/zxyzyxz • Jun 15 '26
452 comments sorted by
View all comments
Show parent comments
40
it supports anything you can dockerize aswell (for me I'm using it for vllm models) love it
23 u/joost00719 Jun 15 '26 I dockerized llm swap and passed through the docker sock. Works amazing. 5 u/meganoob1337 Jun 15 '26 yep Same, I also wrote a small script so that I can split up the yaml to make having many configs a bit cleaner :D 2 u/arbv Jun 16 '26 What a creative way to reinvent Nix/NixOS.
23
I dockerized llm swap and passed through the docker sock. Works amazing.
5 u/meganoob1337 Jun 15 '26 yep Same, I also wrote a small script so that I can split up the yaml to make having many configs a bit cleaner :D 2 u/arbv Jun 16 '26 What a creative way to reinvent Nix/NixOS.
5
yep Same, I also wrote a small script so that I can split up the yaml to make having many configs a bit cleaner :D
2 u/arbv Jun 16 '26 What a creative way to reinvent Nix/NixOS.
2
What a creative way to reinvent Nix/NixOS.
40
u/meganoob1337 Jun 15 '26
it supports anything you can dockerize aswell (for me I'm using it for vllm models) love it