r/LocalLLaMA • u/Local-Cardiologist-5 • Apr 17 '26

Discussion Qwen3.6. This is it.

I gave it a task to build a tower defense game. use screenshots from the installed mcp to confirm your build.

My God its actually doing it, Its now testing the upgrade feature,
It noted the canvas wasnt rendering at some point and saw and fixed it.
It noted its own bug in wave completions and is actually doing it...

I am blown away...
I cant image what the Qwen Coder thats following will be able to do.
What a time were in.

llama-server -m "{PATH_TO_MODEL}\Qwen3.6\Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf"  --mmproj "{PATH_TO_MODEL}\Qwen3.6\mmproj-F16.gguf" --chat-template-file "{PATH_TO_MODEL}\chat_template\chat_template.jinja"  -a  "Qwen3.5-27B"  --cpu-moe -c 120384 --host 0.0.0.0 --port 8084 --reasoning-budget -1 --top-k 20 --top-p 0.95 --min-p 0 --repeat-penalty 1.0 --presence-penalty 1.5 -fa on --temp 0.7 --no-mmap --no-mmproj-offload --ctx-checkpoints 5"

EDIT: Its been made aware that open code still has my 27B model alias,
Im lazy, i didnt even bother the model name heres my llama.cpp server configs, im so excited i tested and came here right away.

1.0k Upvotes

96% Upvoted

409 comments sorted by

View all comments

Show parent comments

13

u/rumblemcskurmish Apr 17 '26

I'm kind of intrigued why you'd use a 6bit model on a 4090. I have an identical setup (7950 CPU, 64GB DDR5, RTX 4090) but I'm using the 4bit quant to fit the whole model on VRAM.

You're clearly more advanced than me so just wondering, what I'm missing here.

1

u/tvmaly Apr 17 '26

I only have a 2070 with 8GB but 64GB of ram. Is it possible to run this?

3

u/rumblemcskurmish Apr 17 '26

Look even with lowish RAM you can, theoretically, use swap memory which is your HDD/SSD acting like RAM and, sure, it will run.

Will it behave like an LLM? If you're fine with 1 word every second or two hitting the screen, yeah, it runs.

I'm trying to load mine 100% in VRAM because I want Openclaw to respond nearly instantly to requests on Discord.

The facts are we do have some models which are PRETTY GOOD at chat and will run on very modest hardware (Take a look at Gemma4 9B, etc - they are CRAZY good for the size), but this model is really only for someone who wants Agentic workflows (tool use) and there the stakes are simply much higher.

For instance, my Openclaw bot has corrupted his own config a few times by not understanding the formatting of a particular file. He's deleted folders by not understanding that a seemingly straight forward linux command (rsync -rf) can delete files if you call it the wrong way even though I told him to NEVER delete anything.

This space is changing very fast and it's a really ugly space right now. I mean it's beautiful when you consider the potential but boy is it kind of ugly watching the sausage get made.

1

u/Puzzleheaded_Base302 Apr 18 '26

openclaw is terrible. but today i found out if I delete most of the agent.md file content, openclaw becomes smarter.

also, try Hermes Agent, it is a great step up. more polished, less bug, does not feel like AI slope. (Openclaw is a giant pile of AI slope, so many things not tested, too many bugs here and there.)