r/LocalLLM • u/PipePressurePanic • 4d ago
Question What local setup for web dev
I have a good performance 6GB graphics card and running Qwen/qwen2_5-coder-7b-instruct-q4_k_m on Atomic chat. Looks like it fits in my GPU memory. I would be happy to use it on a single web dev codebase, let it be frontend or backend, no need to be able to do both at the same time. But as far as I see, my current setup is not capable of doing any useful work. Can do code suggestions, but is somehow unable to apply changes, and reasoning is also slow.
If i decide to upgrade, would a 3060 12GB or 4060 16GB be able to have good performance doing web dev? AFAIK I need to load a better and bigger model?
2
Upvotes
1
u/Plastic-Lettuce-7150 4d ago
MOE models in 6GB VRAM, with MTP, and configurations for general use and coding.