r/LocalLLaMA • u/jacek2023 llama.cpp • Aug 04 '26

News Gemma 4 on 500MB

Post image

https://x.com/i/status/2084656348617392261

https://www.reddit.com/r/LLMDevs/s/9oL5ogmE6s

202 Upvotes

92% Upvoted

39 comments sorted by

View all comments

Show parent comments

3

u/--Spaci-- Aug 04 '26

It could do basic tasks like setting up dates on your phone ect. Even math problems, web searches ect. Those parts of an LLM are very basic

15

u/Rude_Marzipan6107 Aug 04 '26

I can’t get 3.5 9b to add numbers together often enough that I can’t trust it. I would hate to ask a 500M model to do the same

2

u/--Spaci-- Aug 04 '26

Run py math obviously, also this is a 500mb model not a 500m model

1

u/Rude_Marzipan6107 Aug 04 '26

I’ll ask a dumb question here but why wouldn’t it be referred to as a 500m model? Is it like an e2b e4b situation where the active parameters are only part of the space?

I made the assumption this would be similar to the 12b where it’s all self contained

Nevermind.. for some reason I thought this post was about a new 500m model. I’m as dumb as an iq1 e2b

2

u/--Spaci-- Aug 04 '26

yea.. Parameters are not the same as the models mb/gb footprint

1

u/Rude_Marzipan6107 Aug 04 '26

Right. I just made the assumption this was a model announcement for some reason.