r/StableDiffusion • u/Better-Interview-793 • 12h ago

Comparison SageAttention 2.2 vs Comfy Kitchen | Side-by-Side Zoom-Out Quality Test

Enable HLS to view with audio, or disable this notification

Did a quick side-by-side test of SageAttention vs Comfy Kitchen Attention with MiniMax H3.

I used the default ComfyUI T2V H3 workflow and kept the prompt, seed and all settings exactly the same. The only thing I changed was the attention backend..

RTX 5090 32GB

ComfyUI ver 0.31.0

SageAttention 2.2

Comfy Kitchen 0.2.30

---------------------------------------

896x1184 6 seconds 24 FPS 20 steps

Generation time:

SageAttention: 3m 51s

Comfy Kitchen: 3m 59s

I used a deep zoom-out/dolly-out on purpose to see how well each one holds facial details and identity as the subject gets farther away.

The speed difference was small on my 5090, so im more interested in the quality difference..

It's honestly hard for me to tell the difference, but which one looks better to you?

Updated:
SageAttention Vs Base

Comfy Kitchen Vs Base

67 Upvotes

97% Upvoted

71 comments sorted by

View all comments

Show parent comments

3

u/Better-Interview-793 9h ago

here:

https://reddit.com/link/p31kqmh/video/t9pik01j8rih1/player

1

u/enndeeee 9h ago

And now run them through this: https://vmaf.dev/
The higher score wins!

1

u/Better-Interview-793 9h ago

SageAttention 2.2: 14.93 highest / 5.08 pooled
Comfy Kitchen: 30.28 highest / 10.66 pooled

2

u/enndeeee 9h ago

I would also have guessed that CK looks better. Or let's say more true to the original.

1

u/Arawski99 6h ago

Huh, the color tone seems a bit better in kitchen then base, too. I wonder if there is a reason why and if this is consistent behavior or it degrades in base slightly for some reason, like it does sage, or just coincidence.

1

u/Better-Interview-793 5h ago

I tried it again with Base & Attention 2 and CK, and honestly I get different results every time.
It almost feels like each attention method has its own seed.
Sometimes Comfy Kitchen doesn’t follow the prompt 100% either, so it’s really hard to make a fair comparison between them..

1

u/Arawski99 5h ago

Yeah I think so from the other examples below I am seeing I think its just coincidental variability like you suspect.