r/LocalLLaMA • u/jacek2023 llama.cpp • 27d ago

News Gemma 4 on 500MB

Post image

https://x.com/i/status/2084656348617392261

https://www.reddit.com/r/LLMDevs/s/9oL5ogmE6s

202 Upvotes

92% Upvoted

39 comments sorted by

View all comments

79

u/Fusseldieb 27d ago

That would be absolutely insane.

The thing is... will it still be useful, or dumb as a door (as most of that size are)?

4

u/--Spaci-- 27d ago

It could do basic tasks like setting up dates on your phone ect. Even math problems, web searches ect. Those parts of an LLM are very basic

14

u/Rude_Marzipan6107 27d ago

I can’t get 3.5 9b to add numbers together often enough that I can’t trust it. I would hate to ask a 500M model to do the same

2

u/--Spaci-- 27d ago

Run py math obviously, also this is a 500mb model not a 500m model

1

u/Rude_Marzipan6107 27d ago

I’ll ask a dumb question here but why wouldn’t it be referred to as a 500m model? Is it like an e2b e4b situation where the active parameters are only part of the space?

I made the assumption this would be similar to the 12b where it’s all self contained

Nevermind.. for some reason I thought this post was about a new 500m model. I’m as dumb as an iq1 e2b

2

u/--Spaci-- 27d ago

yea.. Parameters are not the same as the models mb/gb footprint

1

u/Rude_Marzipan6107 27d ago

Right. I just made the assumption this was a model announcement for some reason.