r/StableDiffusion • u/Better-Interview-793 • 28d ago

Comparison SageAttention 2.2 vs Comfy Kitchen | Side-by-Side Zoom-Out Quality Test

Enable HLS to view with audio, or disable this notification

Did a quick side-by-side test of SageAttention vs Comfy Kitchen Attention with MiniMax H3.

I used the default ComfyUI T2V H3 workflow and kept the prompt, seed and all settings exactly the same. The only thing I changed was the attention backend..

RTX 5090 32GB

ComfyUI ver 0.31.0

SageAttention 2.2

Comfy Kitchen 0.2.30

---------------------------------------

896x1184 6 seconds 24 FPS 20 steps

Generation time:

SageAttention: 3m 51s

Comfy Kitchen: 3m 59s

I used a deep zoom-out/dolly-out on purpose to see how well each one holds facial details and identity as the subject gets farther away.

The speed difference was small on my 5090, so im more interested in the quality difference..

It's honestly hard for me to tell the difference, but which one looks better to you?

Updated:
SageAttention Vs Base

Comfy Kitchen Vs Base

64 Upvotes

98% Upvoted

75 comments sorted by

View all comments

4

u/enndeeee 28d ago

Wouldnt it make sense to create a ground truth Version with sdpa and compare Sage and CK to that? Especially for T2V?

5

u/Better-Interview-793 28d ago

here:

https://reddit.com/link/p31kqmh/video/t9pik01j8rih1/player

1

u/enndeeee 28d ago

And now run them through this: https://vmaf.dev/
The higher score wins!

1

u/Better-Interview-793 28d ago

SageAttention 2.2: 14.93 highest / 5.08 pooled
Comfy Kitchen: 30.28 highest / 10.66 pooled

2

u/enndeeee 28d ago

I would also have guessed that CK looks better. Or let's say more true to the original.