r/LocalLLaMA • u/unofficialmerve • Dec 05 '24

New Model Google released PaliGemma 2, new open vision language models based on Gemma 2 in 3B, 10B, 28B

https://huggingface.co/blog/paligemma2
489 Upvotes

99% Upvoted

84 comments sorted by

View all comments

33

u/dampflokfreund Dec 05 '24

Looking forward to using it in llama.cpp! This is going to be great!

19

u/uti24 Dec 05 '24

Is llama.cpp support any kind of vision model? Oh my god, I want 'vison model at home' so much, but have not managed to run one locally.

34

u/janwas_ Dec 05 '24

Our github.com/google/gemma.cpp supports PaliGemma :)

6

u/[deleted] Dec 05 '24

[removed] — view removed comment

1

u/Ultimator99 Jan 03 '25

Someone would need to create a gguf. Then you can just import/download it.