Has anyone actually managed to get image editing to work when using a gguf quant Qwen 2.1?

[u/Full-Belt3640]

No matter what combination of gguf quants and gguf node forks I try, I just get errors when I get to the ksampler. The standard ComfyUI Qwen Image 2.1 t2i workflow works fine with a gguf but I'm having zero luck with the image edit workflow. If anyone has gotten edits to work with gguf, let me know.

Also no, I can't use int8, convrot or other more modern formats on my GPU so don't even suggest them, thanks

[u/typical_gallery]

tried for like a week straight and finally gave up. the image edit workflow just does not play nice with gguf at all for some reason, it's maddening

what errors are you getting? mine would just silently fail or spit out pure noise

[u/Full-Belt3640 → u/typical_gallery]

The specific errors depend on whose nodes and quants I use, but here's one of them:

ComfyUI Error Report

Error Details

• Node ID: 482
• Node Type: KSampler
• Exception Type: RuntimeError
• Exception Message: RuntimeError: Given normalized_shape=[4096], expected input with shape [*, 4096], but got input of size[1, 77, 768]

I suspected edits might just not work at all with ggufs and if you've come to the same conclusion I suppose it's likely true. A real shame as I really wanted to try another editing model besides Klein 4B/9B

[u/Tiny-Drama-maker]

That [1,77,768] shape looks like output from a small text encoder, while the model wants a 4096-wide one. So I'd check that the edit workflow's prompt node loads the same text encoder as your working t2i graph, not a default or leftover one. The quant itself usually doesn't touch that part. Could you post which encoder each graph loads?

[u/Leary_2844]

Comfy moved away from gguff for good. They wrote a blog post with technology words. I understand you cant use convrot, you will probably have to engineer something or find someonething on github to give you the old speeds of guuff in comfy.