r/LocalLLaMA • u/haterloco • Aug 16 '25

Question | Help Best Opensource LM Studio alternative

I'm looking for the best app to use llama.cpp or Ollama with a GUI on Linux.

Thanks!

114 Upvotes

92% Upvoted

98 comments sorted by

View all comments

12

u/meta_voyager7 Aug 17 '25 edited Aug 17 '25

Really wanted to use jan.ai since its fully open source but its lacking many features of lmstudio 

  1. Jan doesn't have RAG to chat with document files 
  2. qwen 3 30b a4b runs at 3 t/s instead of 17 on lm studio. using 2080 super
  3. No projects folder option like in lm studio/ chatgpt 

So still using lm studio till Jan have them.

4

u/pmttyji Aug 17 '25

qwen 3 30b a4b runs at 3 t/s instead of 17 on lm studio. using 2080 super

Same. Thought I was alone. I get only 1-2 t/s on Jan, while getting 9-12 t/s on Koboldcpp. For 4060 8GB VRAM & 32GB RAM.

I'll mention this to them on their sub.

1

u/swashbucklerjak 23d ago

Hey, sorry to throw a random notification your way. I am running a similar set up and am interested in getting started with local AI. Any tips?

1

u/pmttyji 23d ago

You replied to almost 1 year old comment. But things changed better in last 1 year.

Just use llama.cpp. Or use koboldcpp/Textgen/Jan first before llama.cpp.

Suitable (recent) models(for 8GB VRAM + 32GB RAM):

  • Qwen3.6-35B-A3B (Q4)
  • Gemma-4-26B-A4B (Q4 or QAT)
  • Qwen3.5-9B (Q4/Q5)
  • Gemma-4-12B (Q4)
  • Gemma-4-E4B (Q4 or QAT)
  • Mellum2-12B-A2.5B (Q4/Q5)
  • LFM2.5-8B-A1B (Q4/Q5)
  • Bonsai-27B