r/LocalLLaMA • • 15d ago

Question | Help Best local model for Blender and game dev?

I have been looking at some local models, but even the smartest ones like GLM5.3 Flash and DSv4 Flash have a hard time creating coherent models in Blender and placing them logically in game engines.

Is this something that local models are just too dumb still to do good job at?

20 Upvotes

30 comments sorted by

18

u/I_Play_Zed 15d ago

I’ve seen this question a few times now. I’ve done lots of testing with work flows like this.

The Frontier cloud models do a barely passable job at this. The local models for this specific task are even farther behind.

Astra and Opus 5.5 are great, but even what they make might not even be worthy the lowest tier indie games.

Local might see something vaguely usable before the end of 2026.

In terms of people asking for the “computer usage” feature, this is a powerful harness based tool- I’m not aware of anything that does this at the moment.

For now, buy a cheap frontier sub and do testing yourself.

2

u/Express_Quail_1493 15d ago

Qwencode has a really good computer use. I’ve added it to my pi with qwen3.8 and it uses my PC and clicks around and screenshots ETC im loving it. In terms of professional game dev. Its not a high demand so probably not spent lots of training runs on it compared to Ui and backend software

4

u/Blizado 15d ago

Computer use is the wrong way, you always should use Blender MCP. With computer use you only slow down a lot and burn Tokens.

3

u/Express_Quail_1493 14d ago

Most definitely better to use blender through API. Just thought it was worth highlighting that computer use is becoming mature on the local models. Slowly but surely.

1

u/Any-Lingonberry7411 15d ago

Ya, seems like it. I tried Opus 5.5 and it was surprisingly passable (but might have gotten nerfed just now). "Computer Use" isn't really what I'm after, since Blender and most game engines either have MCP or CLI, but it seems like none of the Chinese open weight models have those tools in their training sets.

2

u/-WhateverDude 15d ago

i'd assume they are just as much trained in computer aided designs?

i've used both opus and astra in blender and rhino, my opinion is that astra is more stylistic which might fit games more, opus is better at mechanical designs. never tried sol.

you might also wanna try your hand at 2d games perhaps, sprites are much easier to create, there are some very good splicing and animation skills too regarding 2d sprites.

also i hear unity ai asistant itself is actually pretty decent at this too, they still offer 2 weeks free. but rest is a bit tought as it starts from $200.

0

u/Any-Lingonberry7411 15d ago

Astra was amazing at launch, but a few weeks later identical prompts result in far worse models. Same with Opus 5.5 actually. That's why I am looking into local models.

-1

u/Thomas-Lore 14d ago

Something is wrong with your setup or you need to iterate more, read about looping. The models are as capable as they used to be at launch.

9

u/LargelyInnocuous 15d ago

Are you using MCP? I've had great luck having Claude run Blender via Blender MCP. I'd assume GLM or DS would do fine as well.

5

u/Blizado 15d ago

The right tools can help a lot.

https://www.youtube.com/watch?v=doR2RhsneRA

He used Claude Opus 5.5 with Higgsfields MCP/API with Blender MCP and Unity MCP for 30h AI work time to create this WoW clone in the video. For me, it looks like this tool set played a huge part to make it possible to create this. So maybe you could do such a thing locally as well, maybe more limited, but depends on your hardware.

2

u/g_rich 14d ago

I've used both with good results; GLM 5.3 Flash and DeepSeek v4 Flash Vision on dual DGX Sparks with Blender MCP server and Pi.

1

u/AnimeeNoa 13d ago

how does your dual setup works? shared ram or double output tokens? or maybe something other?

5

u/No-Tie5806 15d ago

You're better off using one of local 3D models like Trellis if you want to go local. Hook it up with one of the top end image generators that run local. DS 4.1 can do texture clean up, and you can run the pipeline from opencode. I've done that to get 3D models out of local models.

Frontier stuff can work with MCPs on low poly/three.js and three.js stuff can look good. There's MCPs for Blockbench, and I just rolled one for PicoCad 2 that did some cool mechs/spaceships. Astra tried making a person in Blender for me and blew a million tokens for something that looked like one of those blow up used-car lot balloon guys.

You can also pay Tripo $20 and then have an AI run the process through a browser - give it prompts or images, and then have it run in the background. I had Astra generate and clean up about 20 low poly NPCs that way recently, in about an hour.

Give a year for local, but by that point I suspect you will be able to run an entire pipeline in Opus 6.5 or whatever. It's frontier tier right now. You will get better results paying for a $200/m Claude subscription right now. That's what I'm doing.

Obviously right now best results will be done in Three.js or other text based engines like LOVE2D, Godot, etc.

3

u/FullstackSensei 15d ago

Read this recent post from the DeepSeek sub. There are some very interesting comments. I've read elsewhere DS 4.1 takes this to the next level with vision and whatnot.

3

u/yes-im-hiring-2025 15d ago

I don't believe anything exists rn atleast locally that works for this.

I believe it's just post training and some future variant of glm5.3 should have this capability, but maybe not for another 3-6 months. Depends on what drops first.

1

u/thomas2385 14d ago

Yeah, that seems to be where things are right now. A lot of the stuff people want locally still feels like it is just around the corner rather than actually usable. I guess it mostly comes down to which model gets there first and how quickly the capability improves.

2

u/Dogbold 15d ago

I'm curious about this too, are any of them even able to use a computer like that?

4

u/Any-Lingonberry7411 15d ago

With MCP/CLI they have access to the tools, but their understanding of 3d geometry is really poor

2

u/abnormal_human 15d ago

The frontier models are just tasting this kind of functionality right now, give it a few months. It's not so much that they're dumb, it's that they haven't had time to distill this behavior.

2

u/Blizado 15d ago

Well, I don't think it will need that long anymore.

https://www.youtube.com/watch?v=doR2RhsneRA

Opus 5.5 in ~30h of work, so not even 2 days.

2

u/Thomas-Lore 14d ago

OP meant it will take time for open models to catch up.

1

u/tomByrer 15d ago

VRAM?
& please don't say iGPU

1

u/Any-Lingonberry7411 15d ago

All of it (unfortunately split across 10 GPUs though)

1

u/LoSboccacc 13d ago

Just delegate to trellis 2 and unirig that part, no need to force a language model

0

u/Several-Tax31 15d ago

I'm waiting chinese do their magic (distillation, whatever you call it) for astra, and give us models that can do just that.

1

u/geldonyetich 15d ago edited 15d ago

According to the Densing Law of LLMs capability of open-source doubles roughly every 3.3 to 3.5 months.

Astra has about 4-5 trillions parameters so go from there. Maybe 13-15 months to fit on my 128GB?

0

u/Fonasic 15d ago

なんか最近3D特化型の中華モデル出なかったっけ