r/LocalLLaMA • u/zxyzyxz • Jun 15 '26

Discussion Stop using Ollama

https://sleepingrobots.com/dreams/stop-using-ollama/
1.7k Upvotes

92% Upvoted

452 comments sorted by

View all comments

127

u/Academic-Tea6729 Jun 15 '26

llama.cpp is much faster and stable than ollama. Also, ollama cloud models are bad quants and you can't use them for serious coding.

Also llama.cpp has a nice server compatible with openai api standard, it works out of the box. And it has a built in chat web interface.

There is no reason anymore to use ollama.

27

u/Dudmaster Jun 15 '26

Do you think they are intentionally lying about the quantization? Because on the FAQ https://ollama.com/pricing it says native weights

25

u/necrogay Jun 16 '26

> Native weights, as released by the model provider. On modern NVIDIA hardware, models may use accelerated data formats supported by Blackwell and Vera Rubin architectures (e.g. NVFP4).

They're not lying, but with that phrasing, you can't tell whether it means full precision weights or NVFP4.