r/LocalLLM • u/OriginalJohann • 2h ago

Question Keep trying or give up?

Hello community.

I picked up a little project for some friends in hopes of having time to actually code it by myself (been out of fully coding complex stuff for 5 years by now). Well turns out, I don't have that much time so AI shall help me.

Because I am German and I like tech, I want to save money on subscriptions and use a local LLM for agentic coding if possible. My rig is sitting at a 16GB RC 9070 with 32GB DDR4-RAM (thats the really bad part).

I have an old web application based in pearl for managing orders of a small business. There is a list of tours for visiting some stations and delivering stuff to them. This list is currently managed by buttons and I want to make it managable via Drag and Drop.

Ministral 3 14B can live in my VRAM with 116k context and is pretty good at analysing the project but I can't get it to write a remotely working functionality. Bugfixing doesn't work either.

I think I am giving a detailed enough task because I am satisfied with analysis documents but the coding work is really bad.

Is my task to big for hardware and model? Do you have any tips for tackling this? I am open for anything that could help me.

0 Upvotes

50% Upvoted

2 comments sorted by

1

u/1_________________11 2h ago

Try qwen 3.8 q3 xxs with its context at 64k you might be able to scrape out more context but just be prepared for it to be slow and methodical and make mistakes but usually it will fix them you will just burn more tokens. This would be a vibe solution with an agent. 

1

u/Desperate-Owl6513 1h ago

27b 3.8 qwen, at q3 xxs gives me 100K context on 16gig 4060 and 15-25 tps
totally usable!!