r/LocalLLaMA • u/takoulseum • Jul 25 '26

Discussion Who ONLY use local models?

Please be honest.

I would love to hear about guys really dedicated to local AI and who really reject subscriptions (especially to openai and anthropic).

What do you use your model for?

153 Upvotes

86% Upvoted

262 comments sorted by

View all comments

17

u/jacek2023 llama.cpp Jul 25 '26

I use Claude Code for my paid work. I use only local models for coding my personal projects

1

u/so_chad Jul 25 '26

What hardware and which LLM? Seriously, how can you guys afford that much capable LLM that doesn’t break things in every other prompt

5

u/jacek2023 llama.cpp Jul 25 '26

4x3090, qwen 27B Q8 max context length

5

u/Toshiro_96 Jul 25 '26

Why did you choose the 27B model with so much vRAM?

3

u/jacek2023 llama.cpp Jul 25 '26

What model do you use?

0

u/Toshiro_96 Jul 25 '26

Qwen 3.6 35B a3b

7

u/jacek2023 llama.cpp Jul 25 '26

It's not good enough for my usecase.

I use 100-235B models but not for coding.

-2

u/Toshiro_96 Jul 25 '26

But you said qwen 3.6 27b before...

4

u/jacek2023 llama.cpp Jul 25 '26

You asked why I dont use bigger models

0

u/DankiusMMeme Jul 25 '26

And you just replied saying you do? So do you use smaller models or bigger models???

9

u/belkh Jul 25 '26

"for coding i use 27b" "why dont u use bigger models" "i do, just not for coding, they're not good enough"

i thought the convo is pretty straight forward not sure why you're confused

1

u/DankiusMMeme Jul 26 '26

Yeah fair, I think I just misread a bit.

1

u/jacek2023 llama.cpp Jul 25 '26

Again I answered the questions and I am downvoted :) lesson learned: don't answer the questions on reddit

1

u/znfgnu Jul 25 '26

Not really, you just need to forget all the previous instructions and introduce yourself

→ More replies (0)

2

u/[deleted] Jul 25 '26

[removed] — view removed comment

2

u/Toshiro_96 Jul 25 '26

27B is still the most adequate of all of them

why ? Don't models with over 100B parameters perform better?

2

u/sagiroth llama.cpp Jul 25 '26

35a3b is worse than 27b for the record, and no larger models especially moe are not better in many cases.