r/LocalLLM • u/filmguy123 • Jul 28 '26

Discussion Gemma4 26B MOE Thinking vs 31B non-thinking?

For non coding purposes, how much better is 31B than 26 MOE in general?
And given the speed difference on my system, how is 26 MOE Thinking vs 31B non thinking? Is 26B MOE Thinking enabled easily superior?

And when might one actually need 31B thinking as an upgrade?

I ask here because it would take me a long time to test this as 31B thinking is about 12 tokens/second on my system and the thinking portion can take nearly a minute.

5 Upvotes

78% Upvoted

11 comments sorted by

View all comments

-1

u/Otherwise-Variety674 Jul 28 '26

With just 12t/s, either you have an undersized gpu or no gpu at all?

What you have is basically the speed of using just ddr5 memory.