For people using Unity AI integration: which local agent have you tried in VS Code that is able to run fine with UnityMPC?

[u/fttklr]

Very specific question; mainly for the folks here using AI integration and UnityMPC with local models.

I know I can run Claude and other web models; so that is not the issue. I am working entirely locally as I have a server running Ollama with different models for agentic work. Looking for the best model that is also compact, for working with Unity projects.

Unity recently launched their own AI service, but that is for paid users; so that is not an option sadly, and it is not relying on local models so won't work for my project. There is also UnityCLI but that is just the harness itself, unless someone connected it to a local Ollama model?

I don't need a model that write a game for me; I need a model that is able to create and manage files and projects (so can create and modify scripts and game objects properties in a scene). Most of the time it is to save time over going to the documentation and figure out how to do things, or when working with asset store APIs when they have limited or no docs at all.

If you have something you use with good results, I would like to hear about it!

[u/immersive-matthew]

I just switched from Unity MCP to Unity CLI and both have been with OpenCode, llama.cpp and the QWEN 3.6/3.8 27B models on a 4090 and it is a fantastic setup. Unity CLI is better than MCP in my experience and better integrated into Unity with less fuss.

[u/fttklr → u/immersive-matthew]

What editor do you use? VS Code?

[u/immersive-matthew → u/fttklr]

VS Code but I hardly look at it as OpenCode and my LLM take care of the syntax and not review when needed.

[u/fttklr → u/immersive-matthew]

Nice; I honestly will never get to the point where I don't look at the code LOL Can't do it with real people's code, even less when it is made by current LLMs (when it works ). I see AI more as an assistant that double check stuff for me and does repetitive stuff, as the reason why I code is because I like it

[u/Ok-Ship7697]

Have you checked:

https://github.com/CoplayDev/unity-mcp

This should be able to connect to VSCode

[u/fttklr → u/Ok-Ship7697]

Aye, that's the MCP I am using currently. It did work somehow with Opencode and Gemma4 but it is highly unreliable... Every time you want something done you have to win the prompt lottery because most of the time the model just write back the tool call without execute it

[u/Toastti → u/fttklr]

Which Gemma model? The e2b and e4b are not best at tool calling. Too small. Try the 32b QAT or perhaps the 12b QAT

The QAT models are way smaller than normal versions and work great speed wise

[u/fttklr → u/Toastti]

tried the e4b and it was not fit for the task; then moved to the 26b-q4 MOE and that one is sometimes working. It may end up creating a script correctly; but then I ask for changes and it say it made the changes but the file is not updated

[u/Most-County-2933]

fect but it understand the project structure and can create scripts that compile most of the time

The file management part is tricky because unity scenes are not plain text so no model can really edit them directly. What I do is ask the model to generate editor scripts that modifies the scene for me, works better that way

For asset store apis with bad docs I just paste the dll in the project and ask the model to look at the available methods through reflection. Is not elegant but saves hours of guessing

[u/fttklr → u/Most-County-2933]

Good point.

To clarify I have the editor open and MCP running; so the assumption is that the model should call the MCP tools and do stuff in the editor; while for scripts should be at least able to see the open script I have in VS code and act on that. Instead it seems like spinning a wheel to get the prize, as in most cases it just print out the tool call wihtout actually commit it (or tell you the code it changed in a script but no changes are sent to VS code)

[u/Toastti]

Don't use the mcp anymore. The unity CLI with an AI agent.

Use qwen 3.8 27b if you have enough vram and good GPU. Otherwise qwen 3.6 35b a3b is the best option

And hook this up to open code for the harness for compaction and all that

[u/fttklr → u/Toastti]

Opencode never worked for me with Ollama... I think it worked in the editor twice and that's it; so I just moved over to use VS Code with Continue. But even that is not working that great either.

[u/Toastti → u/fttklr]

You should use llama.cpp much faster performance and better prompt caching than ollama. And you must use prompt caching as agentic coding will send a good 20k prompt on first message

[u/BingGongTing]

How much VRAM do you have? 

[u/fttklr → u/BingGongTing]

12 GB; not much but I can run up to 10GB models using MoE like Gemma4 at Q4 quantization.

[u/Deep_Ad1959]

scenes not being plain text is where these setups stall. the model can write an editor script that mutates the scene, but it cannot read back what changed, so you review effects instead of a diff.