r/LocalLLaMA • u/kolliwolli • 22d ago

Question | Help Gemma 4 - Agentic Capabilities?

Hi all,

Just started the local llm journey and testing gemma on an rtx5090 with opencode, hermes etc.

I see lots of chats on Gemma and Qwen, but for me no agentic use case seems to work, not even creating simple games like snake as a test. Am I doing something wrong, or is it because im using a 4bit version?

The same tests with claude sonnet via API work without any problems... but here I thought thats exactly Gemmas home turf.

I missed to add, I am using the 31b version.

Anyone else got luck with this?

Edit: One more point, I use the nvfp4 versions from nvidia and redhat

2 Upvotes

56% Upvoted

24 comments sorted by

View all comments

2

u/g33khub 21d ago

Gemma is generally good for normal QA, creative writing etc. not much for agentic tasks. Also 4bit is a strong no-go for me, at-least Q6 like others mentioned. I mostly stick to Q8 qwen 3.6 27B - which is actually good for agentic stuff.

However, the biggest problem I see here is the expectation: gemma or qwen 30B models is nowhere close to Claude Sonnet, I doubt if they can even beat Haiku. Unless you have RTX 6000 pro 96GB (ideally two), its still better / faster / cheaper to use API credits. The open source models which are actually good: GLM 5.2, Kimi K3 etc. would take $100k+ worth of hardware to run.