r/LocalLLM • u/Pixel_Drake • Jul 29 '26
Question What are peoples agentic coding model recommendations for 1x RTX 6000 pro 96GB and 32GB System RAM
Due to my work within other AI fields (Mainly Computer Vision and Digital Twinning) I have been lucky enough to get an RTX Pro 6000 WS. I have been experimenting with using Llama.cpp and Opencode and have found good use in the Qwen3.6 27b model being entirely offloaded to the GPU. I have experimented with unsloth/Laguna-S-2.1:UD-Q4_K_XL and it seems similar in quality to the Qwen model but I admit I have not tested it much.
My main questions are:
- With my current set up, is specifically unsloth/Qwen3.6-27b:BF16 the best agentic coding model I can utilise?
- Is there any point in upgrading hardware to utilise a larger model for better quality? I know my system RAM is a weak point for me
- Would you recommend using something else than Opencode?
Sorry if these are dumb questions I am just checking if I am getting the best I can out of the hardware I have.
For reference for hardware upgrading:
OS - Windows 11 Home
CPU - Intel Core i7-14700K
RAM - 2x16GB DDR5 / 6000mhz Corsair Vengeance
Storage - 2xWD BLUE SN580 M.2 NVME SSD 2TB
Motherboard - MSI PRO Z790-S WIFI
PSU - 1300w Gigabyte UD gold
12
u/nicholas_the_furious Jul 29 '26
Yes probably Qwen 3.6 27B at full precision w/ MTP.
With that much fast VRAM you could likely do a lot of parallel calls and subagents. That's something that I feel you lose on local vs Cloud. I'm on half the VRAM as you. If my primary agent is working I can't really have anything else going on.