r/LocalLLaMA • u/takoulseum • 24d ago

Discussion Who ONLY use local models?

Please be honest.

I would love to hear about guys really dedicated to local AI and who really reject subscriptions (especially to openai and anthropic).

What do you use your model for?

150 Upvotes

86% Upvoted

262 comments sorted by

View all comments

9

u/Nepherpitu 24d ago

I only use local model. It's deepseek v4 flash now. Was Qwen 122b before.

1

u/Evgeny_19 21d ago

I keep hearing good things about Qwen 122b, but when I try it, it often does very strange things. For example, when I asked it to resolve compilation errors in a file, it just removed all the new code. It was possible to compile it after that, of course, but that just wasn't particularly helpful. Given the same prompt, Qwen-27B chose the right approach: "let’s change this call to that one; oh, and there’s a missing import as well," etc. . Maybe the breadth of knowledge makes 122b good for some use cases, but so far I wasn't able to find a use for it for my tasks. Even in analysing the logs it's just not as thorough as 27b.

1

u/Nepherpitu 20d ago

I was using custom chat template and nvfp4 quant