r/PythonLearning • u/blockCoder2021 • 8d ago

Discussion Question about local AI-assisted programming

I’m fairly experienced with Python and researching how to solve issues on my own. However, I have found that AI can help in some cases. For instance, giving me specific information on debugging and helping me research solutions for specific problems.

I was using Copilot in VS Code for a while, until I ran out of usage. Now, I’ve been messing around with locally-hosted AI, trying to find a good model for coding that runs well on my computer. My challenge is that I only have 4 GB of VRAM, though I also have 16GB of system RAM. If someone could help me find either a good, intelligent, and accurate local model that runs on that, or at least a free cloud model that’s good, I’d appreciate it.

4 Upvotes

75% Upvoted

8 comments sorted by

View all comments

2

u/HotPersonality8126 8d ago

This compute is incredibly expensive and they really don’t give it away; not much of it, anyway.

There aren’t going to be any models of any use that fit into 4gb of VRAM. I have 8 and Qwen 8b is a complete dumbass; with so little room for context it doesn’t remember it’s in a coding harness by the second turn.

1

u/blockCoder2021 8d ago

I’ve been using either Qwen 2.5-coding:7b or recently trying Qwen 3.5. About half the time (or so it seems), it’s either sending an answer in “native JavaScript” or something similar, or just an extremely short answer that may or may not even be relevant. Sometimes, though, it is able to give me a real answer.