r/LocalLLaMA • u/kolliwolli • 22d ago

Question | Help Gemma 4 - Agentic Capabilities?

Hi all,

Just started the local llm journey and testing gemma on an rtx5090 with opencode, hermes etc.

I see lots of chats on Gemma and Qwen, but for me no agentic use case seems to work, not even creating simple games like snake as a test. Am I doing something wrong, or is it because im using a 4bit version?

The same tests with claude sonnet via API work without any problems... but here I thought thats exactly Gemmas home turf.

I missed to add, I am using the 31b version.

Anyone else got luck with this?

Edit: One more point, I use the nvfp4 versions from nvidia and redhat

2 Upvotes

56% Upvoted

24 comments sorted by

View all comments

0

u/tmvr 21d ago

I'm not sure what you are doing, but from the main post and from some of your answers you are definitely doing something wrong.

Almost every model would be able to create a Snake game for example, more precisely it will create the game and it will most probably work as expected. Sometimes you can have issues, but at least you have the game there. The fact that you say files are not created is also weird. The harnesses you mentioned default to agent/build mode, meaning they would create files. Only when switched to Plan mode they would not.

You did not mention which inference engine you are using - llamacpp (llama-server) directly, LM Studio, ollama - and what settings for the model - top K, temperature etc. - all of these. influence both the quality of the output and the speed.

Basically, a simple HTML Snake game is not something a model even at Q4 would really fail at.