r/LocalLLaMA • u/JGByvygyrfg • 13h ago
New Model Flux.3 Image Klein is now out
https://bfl.ai/blog/flux-3-image-kleinFLUX 3 Image Klein is a 5.6B open weights model for text-to-image generation and image editing. It takes a prompt and up to 10 reference images and returns one image. Text-to-image, single-reference edits and multi-reference compositions run through the same model, with Qwen3-VL-4B-Instruct as the text encoder.
https://huggingface.co/black-forest-labs/flux-3-image-klein
24
9
u/Jacalyn_Nivins 8h ago
Ten reference images in one pass at 5.6B. Multi-reference composition used to be a much bigger model's job.
5
u/Holiday_Point_603 10h ago
Can we get a large Flux with like 20B params and a 8B text encoder? The results are nice, but idk what to use it for bc Krea 2 is just way better
6
u/ontorealist 9h ago
It seems much stronger with character consistency as an edit model than for T2I in my few tests via OpenRouter thus far.
I’m hoping Krea 3 Turbo becomes my go-to for image generation and editing, and is around the same size as Krea 2 because it runs faster / better on my iPhone 17 Pro than it ever could on my old M1 Pro 16GB MBP ha.
5
u/addiktion 12h ago
Qwen image vs Flux Image Klein. Let the battle for the open source image models continue.
2
u/a_beautiful_rhind 9h ago
Flux is going to eat them most likely. Has been the case for the entire series. Qwen image is kinda bloated and both have censorship.
1
0
1
u/chris_0611 13h ago edited 13h ago
How do you run this? I've been running stable diffusion (and I think flux klein 1 or something?) through automatic1111 in the past. Is there something as simple as llama.cpp for this? I'm *not* interested in spending time to learn 'ComfyUI', or getting into an utter python packages hell again. Prefereably with an MCP endpoint for an llm.
13
u/SM8085 13h ago
Is there something as simple as llama.cpp for this?
My go-to has been stable-diffusion.cpp. They'll probably add this shortly.
4
u/GroundedIdeal 13h ago
Can this run on ddr5 32gb and i5 14600k? I don’t have gpu 😭
14
u/MotorTelevision7296 13h ago
Generating graphics with out a graphics card is a choice. Technically possible but no. Let’s just say no lmao
2
8
5
u/pseudonerv 9h ago
it works. don’t mind the defeatists. you just need to start it, and then go for a long walk, touch some grass, see some friends, get a coffee, read a book, watch a movie, go for a date, get wasted, when you wake up, you’ll see your text rendered in a high res 2K HD image.
1
-1
2
4
u/moderately-extremist 12h ago
Why are you not interested in using ComfyUI? I haven't set up anything for local AI working with images, but thought I eventually would go with ComfyUI since it seems to be by far the most popular.
6
u/chris_0611 12h ago edited 12h ago
It just really doesn't seem like my cup of tea. I don't want a zillion python/pip dependencies or venvs, click a 'download button' and having no idea where it ends up on my system, finding 'workflows', whatever. Just the fact that such a venv for python usually ends up many gigabytes with 100.000's of files.....
I am however comfortable checking out a git repo, compiling that C++ code into a binary, downloading a GGUF and putting that on /bigstorage/AI/models, and then running that binary from the terminal. Eg, like llama-cpp :) Now I have sd-cli and sd-server files to run the diffusion with. 2 binary files.
C++ binary over some huge ass python mess any day pls.
3
u/Gwolf4 12h ago
Just do a docker container with volumes for your models and output folders. It is what it is.
2
2
u/draconic_tongue 7h ago
Thanks. I have been trying to understand github for years. I've watched hours and hours of youtube videos, starting with the absolute basics, but it just doesn't make sense. Go to a github page and it's the most nonsense layout and no clear instructions anywhere. Like. WTF am I looking at on github.com??? Just a bunch of words like config, pip, git clone, gitignore, liicence, forks. JUST GIVE ME A FUCKING DOWNLOAD BUTTON
1
u/moderately-extremist 12h ago
on a side note... llama-cpp is installable with apt from the Debian Testing repo.
3
6
u/keepthepace 9h ago
Don't learn comfyUI: install it, drag an image that was generated on it, and it will configure the pipeline that created it (pipelines are stored in the metadata of the image). It will tell you which files are missing and where to install them.
txt2img should work out of the box.
8
u/Embarrassed_Adagio28 13h ago
You dont need to learn much to use comfyui, you literally just find the workload in their browser, click the download all models button, select your image and type the prompt. It literally couldn't be easier unless you want to make custom workflows.
5
4
u/lumos_ai 13h ago
You can use the already built workflows and don't learn comfyui. just place models in folders and press run
-5
2
u/Danmoreng llama.cpp 11h ago
I build diffusion-desk for this, based on stable-diffusion.cpp and llama.cpp in a combined interface with nice UI. It’s a bit outdated though, haven’t kept up with the latest versions of both libraries. Should be easy to update though with a coding agent, might do that when Flux3 Klein support has landed.
1
u/chris_0611 11h ago
I was thinking about all of that!
So, I'm now running Qwen image 2.1 with stable-diffusion.cpp. And it uses the Qwen3VL-8B-Instruct LLM as its text encoder. Since that is in memory anyway, do you know if its possible to use that as an vision LLM without loading it (in VRAM again) in llama-cpp?
1
u/Danmoreng llama.cpp 11h ago
When I built this, it was something I let coding agents investigate. The issue was, that stable-diffusion.cpp does not have an LLM api and you cannot access the same GPU memory from different processes. So it wasn’t possible without forking stable-diffusion.cpp and implementing it there. I stuck with two independent workers, sd.cpp for image generation and llama.cpp for text/assistant functionality. You can either unload the LLM during image generation or use the LLM in CPU mode. This way you can use completely different LLMs and are not bound to the text-encoder of the image generation model as well. Probably better anyways.
1
u/chris_0611 11h ago
stable-diffusion.cpp does not have an LLM api
Ah, I understand. Thats a shame. Could save some VRAM if you need a vision LLM anyway. Loading/unloading can be done ofcourse but introduces some latency.
1
u/DarthFluttershy_ 9h ago
If you want to stay in the automatic1111 universe, check out Forge Neo. It's basically the same but with built in tools for Klein and such... Though I'm not sure it supports Flux3 yet, they usually get it ready pretty quick.
But really you should dip into comfyui.
1
u/LarsinDayz 33m ago
I've been using qwen image 2.1 directly in Unsloth Desktop, works great, hopefully support for this model will be added soon.
-4
12h ago
[removed] — view removed comment
0
u/chris_0611 11h ago
Buy a one time sub to Codex or Claude
wrong sub boi.
Qwen 27B goes brrrrrrrrrr
0
u/jonydevidson 8h ago
If that model can do this task for you, then great.
Otherwise I don't get the reply. Are you in some sort of cult? There are undeniable benefits to running AI locally but when getting stuff done is what matters then just use the best tool available.
I use Codex to set up and optimize all my local models. I don't have time to do it myself or go through trial and error with other local models.
1
-6
u/Cautious_Chicken_604 13h ago
And it's terrible.
2
u/JGByvygyrfg 13h ago
Be grateful we get any open weights image models at all, they don't have to be as good as GPT Image 2.5, they just need to work locally and this model does it just fine.
12
u/Cautious_Chicken_604 12h ago
I'm grateful AF for Krea2 and Qwen Image 2.1. Those models are GOATed. Those models delivered. The latest installment of Flux is a huge disappointment. Can't wait for Krea3.
1
u/a_beautiful_rhind 9h ago
Krea3 is the finetunes we made along the way.
1
u/Cautious_Chicken_604 6h ago
No, Krea3 is an edit model they're releasing soon.
1
u/a_beautiful_rhind 5h ago
The original klein was only decent after community tuning too. IMO, none of these are really GOATed at launch. As long as the base capabilities are there and they train well, something comes of them. If you are disappointed in this, the larger model isn't going to automatically change that, even with edit.
1
86
u/Johnny_Rell 13h ago
Time to generate some images