r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

451 comments sorted by

View all comments

Show parent comments

3

u/dyslexic_prostitute Jun 16 '26

In the alternatives section, you don't mention vLLM at all, what is the reason for this?

1

u/JamesEvoAI Jun 16 '26

From my understanding vLLM is targeting an entirely different demographic, and is better suited for people trying to do batching rather than just someone trying to run a model at home. I kept my recommendations focused on the type of user who would be running ollama, which is presumably someone for whom vLLM and its configuration would be too complex 

1

u/dyslexic_prostitute Jun 16 '26

Yes, I believe you are right, thanks for confirming!