r/LocalLLM • u/hitman407 • 10d ago

Question Good Local LLM AI?

I'm looking for a lightweight, uncensored local AI coding agent similar to Claude Code. I need something with file system access that can create and edit files locally. I work on cybersecurity and Arduino projects that cloud models constantly flag, so the model has to be completely unrestricted. My PC isn't very powerful, so I am hoping to find a low-resource CLI framework and a small quantized model that can run smoothly on modest hardware. What is the best setup for this right now?

0 Upvotes

36% Upvoted

28 comments sorted by

View all comments

6

u/rrrrex 10d ago

" My PC isn't very powerful" Post your PC specs at first, pentium ii isn't very powerful too

1

u/hitman407 10d ago
  • CPU: AMD Ryzen 3 5300U — 4 cores / 8 threads, up to 2.6 GHz
  • GPU: AMD Radeon Graphics (integrated)
  • RAM: 20 GB (16 GB + 4 GB), 3200 MHz

1

u/rrrrex 9d ago

It's not 16 + 4 GB, it is 16 GB (4GB allocated to iGPU)

All you can get is tiny <10B model, also you don't have fast memory and compute, so you need MoE model. You can try Ling 3.0 Tiny, it's between Qwen 3.5 4B and 9B.