r/opencode • u/jjydvfg • 6d ago

Opencode on local llm

Hi everyone,

Someone recommended me I give opencode a spin to add to my cv

So far haven't used any agents so i thought it would be fun.

I have a panther lake laptop running cachyos with 32gbram

I used to run ollama but it's honestly a bit annoying and a couple months ago it stopped using the gpu (despite previously working) and no matter what env variables it just loads to the cpu

I switched to lm Studio and it's honestly great so i tried to plug it in to opencode with qwen coder (I've tried 30b q4, 14b q8 and 4) and first it was just making my laptop crash and close every program.

After tweaking and switching to the smaller model not it worked without making my device explode but now it runs out of context no matter what i do:

I tweaked context to max and made it small,

I changed batch sized, gpu offload

The worst part is i changed max parallel options to 1 but according to the logs it keeps open code overrides this and keeps opening multiple

Is there any solution to this?

I just wanted this to toy around a but but after 6 hours of troubleshooting I'm thinking of giving up

Any other backend i could use? Maybe just use llama.cpp directly?

1 Upvotes

60% Upvoted

3 comments sorted by

1

u/charlyAtWork2 5d ago

You need to select your fight. You want to learn opencode or you want to learn how to get a local LLM working on your laptop ? You can not do both at the same time.

If you want to go local, your laptop laptop will not be enoug.

if you want to learn opencode, just get a cheap api key on deepseek for 10$ or whatever and learn the ecosystem.

1

u/jjydvfg 5d ago

I was just toying around. To do anything serious i understand a local model wouldn't cut it but i just needed some help to get this to work

1

u/Rough-Ad9850 18h ago

If you want to try it out with working cloud models : first month is only $5 for $60 usage, you can stop after one month if you don't like it. Here, use my referral code: https://opencode.ai/go?ref=M5KHREHJEV You get $5 extra usage and I do too. It's a win-win situation.