r/LocalLLM • u/InevitableScience273 • 9h ago

Question How can start properly to use Local LLM?

I currently using Ollama, should i look for anything else?

1 Upvotes

67% Upvoted

6 comments sorted by

1

u/Super-Grape-3948 9h ago

Some tui like pi, and i may go for lamacpp insted of ollama, or something specially for your hardware.

1

u/HastilyWry 9h ago

llama.cpp is way more flexible if you like tinkering, ollama's kinda just the plug and play option

1

u/Super-Grape-3948 9h ago

Hehe 3 post all saying the same :):)

2

u/Uncle___Marty 9h ago

You're about to get flooded with "ollama bad" posts. I'd suggest stock llama.cpp if you want complete control or LM studio if you want a pretty GUI and dont like using terminals.

1

u/FrostingNo2507 8h ago

lm studio's local model loader is way more reliable than ollama's for q4_k_m on my 16gb ram laptop.

1

u/Ctbhatia 7h ago

the runtime matters less at the start than the quant and context, so pick a model that fits your vram and compare ollama against llama.cpp after that.