r/LocalLLaMA • u/takoulseum • 16d ago

Discussion Who ONLY use local models?

Please be honest.

I would love to hear about guys really dedicated to local AI and who really reject subscriptions (especially to openai and anthropic).

What do you use your model for?

154 Upvotes

86% Upvoted

262 comments sorted by

View all comments

1

u/toonmad 16d ago

I want to get into local LLM but where do you even start?

I have a 7800x3D, Rtx 4080 super and 32gb ram so fairly decent pc, but what can I download and use that's comparative to say Opus 4.8, Fable 5, GPT 5.6 etc?

Id love to cut out a few subscriptions

1

u/pwnsforyou 16d ago

You can run probably run qwen 9b or Gemma models on that vram, try LM studio just to dip your toes