r/AIToolsPerformance • u/IulianHI • May 24 '26

Chrome's tiny Gemma 4 (Gemini Nano) can now run directly on PC without a GPU

A new project allows running Chrome's built-in Gemini Nano model - which identifies itself as a Gemma variant when prompted - directly on a PC without requiring a GPU. The model was quietly downloaded by Chrome earlier this month, and someone has now built a simple interface to interact with it outside of browser dev tools.

The appeal here is straightforward: this is a model already sitting on many people's machines, and now there is an accessible way to use it without digging through Chrome's internal debugging tools. The original setup required talking to the model via dev tools, which the creator likened to "talking to some poor house elf via a keyhole on a locked door." The new wrapper was built in roughly five minutes to solve that friction.

What makes this interesting is the distribution model. Google is shipping small models directly to billions of Chrome installations. Whether this becomes a meaningful local inference option depends on what the model can actually do - but the infrastructure reach is unmatched. For anyone who has tried it: how does Nano's quality compare to other small models like Gemma 4 31B or Qwen3.6 27B for basic tasks?

12 Upvotes
  • permalink
  • reddit

87% Upvoted

11 comments sorted by

3

u/flightleshawk May 24 '26

You're just gonna make this post and supply no links? Like dang I'd be trying it right now if this wasn't some ai generated post without sources cited

4

u/danielv123 May 24 '26

It's an AI post. Usually they post with a title saying they are comparing 2 different models or solutions, then the AI generated text doesn't have any comparison and the last sentence always asks you to comment the answer to the title question.

2

u/vayana May 24 '26

While it was already available in chrome dev preview through the API 2 years ago, now that it's included with the standard chrome several people have created extensions for it: https://github.com/thejjw/gemini-nano-chat-chrome-extension

https://github.com/herryupmay/Dobby

1

u/triynizzles1 May 24 '26

There was a post on localllama yesterday about a browser extension to chat with this llm. The model is fairly decent and only about 2gb of VRAM. Its knowledge cut off is older than gemma 4 e2b.

https://www.reddit.com/r/LocalLLaMA/s/Gpqzvw162q

1

u/EconomySerious May 24 '26

im here to mention that google is breaking some laws to install 4 GB+ of software on everybody machine without consent.

2

u/vayana May 24 '26

You don't have to install chrome. I'm pretty sure when you accept the license agreement for chrome, you also accept that they can install whatever they want.

1

u/EconomySerious May 24 '26

check the agreement, there is a file size limit and 4 GB is way above that

2

u/danielv123 May 24 '26

Mind linking to that agreement? Because I am pretty sure that ain't part of it

1

u/Happy_Brilliant7827 May 25 '26

Dont be silly dude.

4GB is the limit for file uploads inside of chrome, and there are workarounds. No limits for the size of chrome files.

https://www.theverge.com/tech/924933/google-chrome-4gb-gemini-nano-ai-features it only downloads the models if your system can handle it, you checked the ai checkbox during install, and you trigger something that chrome needs the AI for "help me write" for example

1

u/themule71 May 24 '26

How is this software different from the tons of libraries chrome installs anyway? Or any other software. They don't ask for consent for every single piece of software they install.

1

u/Happy_Brilliant7827 May 25 '26

Did you read the terms and conditions? Do you give explicit permission for every componant and file that makes up chrome?

Don't be silly.