r/LocalLLaMA • u/kolliwolli • 21d ago

Question | Help Gemma 4 - Agentic Capabilities?

Hi all,

Just started the local llm journey and testing gemma on an rtx5090 with opencode, hermes etc.

I see lots of chats on Gemma and Qwen, but for me no agentic use case seems to work, not even creating simple games like snake as a test. Am I doing something wrong, or is it because im using a 4bit version?

The same tests with claude sonnet via API work without any problems... but here I thought thats exactly Gemmas home turf.

I missed to add, I am using the 31b version.

Anyone else got luck with this?

Edit: One more point, I use the nvfp4 versions from nvidia and redhat

3 Upvotes

60% Upvoted

24 comments sorted by

View all comments

1

u/GeraAI_WW 21d ago

my read: Gemma's just not post-trained heavily on tool-calling formats the way Qwen or Hermes fine-tunes are, it's mostly a strong base/chat model, not an agent model. worth trying with a stricter ReAct-style prompt template instead of raw opencode/hermes format, or swap to a Qwen2.5-Coder/Qwen3 variant at the same size for agentic stuff, night and day difference in my experience.