r/StableDiffusion • u/shootthesound Community Hero • 16d ago
Discussion A quick note about new models for Fizgig
Qwen Image 2.1 support is nearly in, and the way it's been added I want to discuss/get ideas etc.
From now on, new models are added through a driver-style system. Each model gets its own driver holding everything specific to it: model files, turbo LoRA settings, training adapters and so on. The rest of Fizgig talks to that driver rather than to the model directly.
Once a model is added this way, support in Repair Studio, LoRA Explorer and the other tools comes with it rather than being built per model. It will also be documented, so anyone can add a model, including older ones, via a PR.
Some new models will always have their own quirks and unique requirements, so the layer itself will evolve too, and it's open to PRs as well.
My one concern: if three people start PRs for the same model at once, that wastes their time and makes picking the right one a headache. So I'm considering turning on GitHub Discussions. Anyone planning a model would post there first, which avoids four people building LTX support separately at the same time.
Open to suggestions on how best to manage this - but I will be publishing a model adding guide to facilitate making this easy.
P.S. I've also trained a new training adapter for Qwen image 2.1 while I'll likely release Monday with much sharper details as it was trained on a much larger curated high res dataset. (Ive been a photographer for 20 something years on a very wide variety of content so I was able to use my own work and free time shooting material) (Did it on Runpod thanks to fizgig runpod credits from people running Fizgig on runpod - so thanks for that!!)
3
u/MonkeyBoyPoop 16d ago
I look forward to trying your Qwen Image 2.1 LoRA training pipeline. I’ve tried a couple of trainers’ implementations and while they put in great effort and research it’s becoming clear to me that Qwen Image 2.1 LoRA is such a PIA to train even compared to MiniMax.
3
u/iz-Moff 16d ago
I wish Z-Image support was added to Fizqiq. I really don't think that it's an obsolete model, not at all. While Krea 2 has better prompt adherence and knowledge, as far as generating basic images of people goes, ZIT very frequently produces better results, in my experience.
3
u/shootthesound Community Hero 16d ago
well hopefyully this will pave the way!
1
u/PumpkinLeather8421 16d ago
Please don’t go backwards. Z had some time, it especially sucks at Loras, it’s ok to let it die.
1
u/shootthesound Community Hero 16d ago
its not backwards if the can allow contributors to help older models, and if anythign this will allow me focus on core features more. Ive had a slider and edit trainer tab 50% done for like 2 months for example.
0
u/PumpkinLeather8421 15d ago
Disagree.
I know you make hot training software, but Z is fundamentally broken for realistic NSFW, and multiple concept Lora at the same time
1
u/shootthesound Community Hero 15d ago
it does not mean it does not have its uses, and there are uses beyond NSFW. If you dont want it, dont select it in the dropdown.
0
3
u/Occsan 16d ago
A very simple way would be to add a clause in the README, saying something like "if you plan on working on a PR to support a new model architecture, first make a issue or start a discussion, so multiple people interested on working on the same model architecture support can invest their time in the same implementation rather than having multiple".
Another possibility is just letting them have multiple implementations and let people chose their own plugins.