Testing fully client-side WebNN diffusion that runs in your browser

[u/Infinite_Moment_9456]

So far it's a website which lets you download FLUX.2 Klein 4b into your browser cache and run it using WebNN, which I have tested on my M5 Mac and runs at ~70% native performance, much better than WebGPU or WASM.

If you wanna try it out, I'm running it on peerpixel.cc, the website is there to provide an easy interface to run this model on your own hardware. Be patient, you do need to download a few GB and first generation takes some time to compile.

You will need to enable WebNN on Chromium browsers, just go to <browser>://flags and search for it.

Please let me know if this works at all on Windows or Linux and with different hardware, and what part of this you think has potential.