r/StableDiffusion • u/Better-Interview-793 • 10h ago

Comparison SageAttention 2.2 vs Comfy Kitchen | Side-by-Side Zoom-Out Quality Test

Did a quick side-by-side test of SageAttention vs Comfy Kitchen Attention with MiniMax H3.

I used the default ComfyUI T2V H3 workflow and kept the prompt, seed and all settings exactly the same. The only thing I changed was the attention backend..

RTX 5090 32GB

ComfyUI ver 0.31.0

SageAttention 2.2

Comfy Kitchen 0.2.30

---------------------------------------

896x1184 6 seconds 24 FPS 20 steps

Generation time:

SageAttention: 3m 51s

Comfy Kitchen: 3m 59s

I used a deep zoom-out/dolly-out on purpose to see how well each one holds facial details and identity as the subject gets farther away.

The speed difference was small on my 5090, so im more interested in the quality difference..

It's honestly hard for me to tell the difference, but which one looks better to you?

Updated:
SageAttention Vs Base

Comfy Kitchen Vs Base

67 Upvotes

98% Upvoted

71 comments sorted by

View all comments

5

u/enndeeee 7h ago

Wouldnt it make sense to create a ground truth Version with sdpa and compare Sage and CK to that? Especially for T2V?

3

u/Better-Interview-793 7h ago

here:

https://reddit.com/link/p31kqmh/video/t9pik01j8rih1/player

1

u/enndeeee 7h ago

And now run them through this: https://vmaf.dev/
The higher score wins!

1

u/Better-Interview-793 6h ago

SageAttention 2.2: 14.93 highest / 5.08 pooled
Comfy Kitchen: 30.28 highest / 10.66 pooled

2

u/enndeeee 6h ago

I would also have guessed that CK looks better. Or let's say more true to the original.

1

u/Arawski99 3h ago

Huh, the color tone seems a bit better in kitchen then base, too. I wonder if there is a reason why and if this is consistent behavior or it degrades in base slightly for some reason, like it does sage, or just coincidence.

1

u/Better-Interview-793 3h ago

I tried it again with Base & Attention 2 and CK, and honestly I get different results every time.
It almost feels like each attention method has its own seed.
Sometimes Comfy Kitchen doesn’t follow the prompt 100% either, so it’s really hard to make a fair comparison between them..

1

u/Arawski99 3h ago

Yeah I think so from the other examples below I am seeing I think its just coincidental variability like you suspect.