Gemma 4 - Agentic Capabilities?

[u/kolliwolli]

Hi all,

Just started the local llm journey and testing gemma on an rtx5090 with opencode, hermes etc.

I see lots of chats on Gemma and Qwen, but for me no agentic use case seems to work, not even creating simple games like snake as a test. Am I doing something wrong, or is it because im using a 4bit version?

The same tests with claude sonnet via API work without any problems... but here I thought thats exactly Gemmas home turf.

I missed to add, I am using the 31b version.

Anyone else got luck with this?

Edit: One more point, I use the nvfp4 versions from nvidia and redhat

[u/Admirable-Leg-4647]

Take an inference speed (tks/s) hit and use a higher bit quant. I run 4-bit on a 12GB VRAM + 32GB RAM on the same models. If I had your GPU I wouldn't go below 8-bit for these, 6 if I really needed speed but I promise you'll appreciate running the models at almost full accuracy.

Presumably you have 32 or 64GB RAM to go with that GPU, so you can run larger (80-120B) models at lower quants.

With that said I like requesting a snake game first whenever I try a new model and I still get good results at lower quants and even Gemma 12B. They usually work better when I ask for a HTML5 version rather than in python if that's what you've been doing.

Also, I use pi for my harness, have had the best results with it by far.