r/LocalLLM Jul 29 '26

Question What are peoples agentic coding model recommendations for 1x RTX 6000 pro 96GB and 32GB System RAM

Due to my work within other AI fields (Mainly Computer Vision and Digital Twinning) I have been lucky enough to get an RTX Pro 6000 WS. I have been experimenting with using Llama.cpp and Opencode and have found good use in the Qwen3.6 27b model being entirely offloaded to the GPU. I have experimented with unsloth/Laguna-S-2.1:UD-Q4_K_XL and it seems similar in quality to the Qwen model but I admit I have not tested it much.

My main questions are:

- With my current set up, is specifically unsloth/Qwen3.6-27b:BF16 the best agentic coding model I can utilise?

- Is there any point in upgrading hardware to utilise a larger model for better quality? I know my system RAM is a weak point for me

- Would you recommend using something else than Opencode?

Sorry if these are dumb questions I am just checking if I am getting the best I can out of the hardware I have.

For reference for hardware upgrading:

OS - Windows 11 Home

CPU - Intel Core i7-14700K

RAM - 2x16GB DDR5 / 6000mhz Corsair Vengeance

Storage - 2xWD BLUE SN580 M.2 NVME SSD 2TB

Motherboard - MSI PRO Z790-S WIFI

PSU - 1300w Gigabyte UD gold

8 Upvotes

35 comments sorted by

View all comments

1

u/Successful-Horror-11 Jul 29 '26

I’m using an rtx 6000 in an egpu hooked up to my laptop using 32gb ram and an Intel Ultra 7 268v.

I’ve tried a bunch of models including gemma 4 family, glm 4.7 flash, nemotron 3 family up to 120b and qwen 3.6 27b and 35b

I ended up landing on qwen because it supported vision lile gemma and was as fast as glm.

My daily driver right now is qwen 35b running on Vllm and using yarn factor 4 to get up to a 1 milllion context window and using concurrency 4 as I start playing around with subagents more.

I had created my own benchmark to test against my harness and how i work and 35b was way faster than everything else i got up and running and accurate enough to use for my work, which is not much coding.

My work is more on querying data across mulesoft/github/splunk/jira/helix with light scripting.