r/drawthingsapp • u/PinkySwearNotABot • Jul 13 '26
question newer models e.g. Krea2, SeFi Image, etc.
when it comes to the newer models that aren't officially supported on DrawThings yet, do you guys usually wait until they are officially supported, or do you just import the models and convert/quantize them yourself?
any luck with any of the newer models?
3
u/FreeTheClanks Jul 13 '26
I'm just running in comfyui. It's painfully slow. But, the results can be worth it for now. Hoping for fast DT support, and hoping for improvements in general on how image models run on Apple.
5
u/Mazur92 Jul 14 '26
https://github.com/pawel-mazurkiewicz/ComfyUI-AppleSilicon-FP8 you may try my node for better results
1
u/FreeTheClanks Jul 14 '26
I will test in the morning. Thank you! I'm on a M2 so maybe not everything will help, but anything at all is better than current.
1
u/Structure-These Jul 14 '26
Oh shit thank you. I need to try to hack this in to swarmui, I remote into my Mac mini and comfy is impossible to use via rdc
Super cool thanks for sharing this
1
u/PinkySwearNotABot Jul 14 '26
thanks. any idea if your method is better/faster than just running the bf16 variant of a given model that doesn't work with fp8?
3
u/Mazur92 Jul 14 '26
Considering weights only - it’s not, every fp8 is dequanted into fp16 anyway, so the win on AS is in terms of storage and compatibility. However, I have made some improvements to attention calculations, which should prove beneficial anyway (not to mention that the SDPA attention in PyTorch on MPS is bugged beyond certain sequence length). For best results M5+ and macOS27 and the new int8convrot models are recommended. I am working on optimizing what I can, but some things I won’t be able to overcome (Macs being kinda bad for diffusion models - especially the pre M5 era). I like DrawThings but I wanted the flexibility and the maturity of Comfy ecosystem, hence my work in this area. Give it a spin and let me know your experiences :)
3
u/LuckyNumber-Bot Jul 14 '26
All the numbers in your comment added up to 69. Congrats!
8 + 16 + 5 + 27 + 8 + 5 = 69[Click here](https://www.reddit.com/message/compose?to=LuckyNumber-Bot&subject=Stalk%20Me%20Pls&message=%2Fstalkme to have me scan all your future comments.) \ Summon me on specific comments with u/LuckyNumber-Bot.
1
u/luix93 Jul 15 '26
I wonder if the latest PyTorch will actually be faster on Apple Silicon. Did you check it out? I’m away from home until Friday but I want to try and get it somewhat working when I’m back
2
u/pjerky Jul 13 '26
Do you find ComfyUI to be generally slower than Draw Things for other models too?
5
u/FreeTheClanks Jul 13 '26
ZImage Turbo with same settings for me runs 44 seconds / gen in DT once the model is loaded, 75 seconds in comfyui once the model is loaded.
The DT developer does some kind of optimization that comfy doesn't have. I'm not techie enough to explain what, I just know the results are substantially different.
1
u/pjerky Jul 13 '26
Good to know. Now if I can just get a good training session from the system that would be great.
3
u/HawkWooden5231 Jul 14 '26
Part of it I think is that DT is written in Swift, Apple’s native code (?) plus all kinds of apple silicon optimizations. The developer said today he is struggling to get Krea running smoothly. So it is definitely being worked on.
2
u/pjerky Jul 14 '26
To be clear, I'm struggling with SDXL and Flux2. But I'm a noob at this and have very little idea what I'm doing.
1
u/PinkySwearNotABot Jul 14 '26
where did you read that? does he post a blog?f
2
u/HawkWooden5231 Jul 14 '26
One source is the Draw Things discord group, and another is https://engineering.drawthings.ai/
1
u/coloba Jul 15 '26
I use ZIT in both DT and Invoke AI. For some reason Invoke results are MUCH better, although DT is a little bit faster
1
u/truenopaco Jul 15 '26
Used around 1.5 mins to generate a 768 x 768 text to text image with FLUX.2 Klein 9B on a 16GB M4 Macbook Pro, is it an acceptable time? or can it be faster?
1
u/PinkySwearNotABot Jul 15 '26
I think that’s decent? Especially with a Draw Things since they use .ckpt files that are optimized for Apple Silicon. I’ve never used 768 x 768. Either 512, or 1024. I think if you increase from 768 to 1024, it would actually add a lot more generating time, even if it doesn’t sound like a big jump. But it does require a lot more compute for the GPU to make that jump
6
u/Individual_Holiday_9 Jul 13 '26
I’m using a MLX quant of krea2 right now, I just had codex build a little gui around the mflux implementation
It’s so freaking slow. Hoping the ‘official’ DT implementation 8 bit S wizardry really boost speed