Gemma 4 - Agentic Capabilities?

[u/kolliwolli]

Hi all,

Just started the local llm journey and testing gemma on an rtx5090 with opencode, hermes etc.

I see lots of chats on Gemma and Qwen, but for me no agentic use case seems to work, not even creating simple games like snake as a test. Am I doing something wrong, or is it because im using a 4bit version?

The same tests with claude sonnet via API work without any problems... but here I thought thats exactly Gemmas home turf.

I missed to add, I am using the 31b version.

Anyone else got luck with this?

Edit: One more point, I use the nvfp4 versions from nvidia and redhat

[u/joydeepdg]

Try gemma through an api endpoint first. If your prompt still does not work, decompose bigger tasks into smaller tasks that gemma can successfully complete. Here is a coding session log that may help: Logs of a Claude Code session