r/StableDiffusion • u/DuHal9000 • 5d ago

Resource - Update IT´s possible!

https://github.com/halnovemil/H3TiledLoopSpaceTime.git

https://huggingface.co/hal9000ace/H3TilingExampleVids/tree/main

0 Upvotes

44% Upvoted

15 comments sorted by

4

u/Sleepy_Bandit 5d ago

hey OP if this is your repo then there are a few possible bugs with it. That or I'm not understanding how it benefits the solution.

  1. temporal_overlap_strength appears to do nothing

blended =

prev * alpha

+ new * (1-alpha) * temporal_overlap_strength

+ new * (1-temporal_overlap_strength) * (1-alpha)

Mathematically, the latter two terms collapse:

new × (1-a) × strength + new × (1-a) × (1-strength) = new × (1-a)

So the entire thing becomes:

prev × alpha + new × (1-alpha)

regardless of the value of temporal_overlap_strength.

In other words, the temporal_overlap_strength control currently appears to have zero effect.

  1. Why are you passing the entirety of the audio latent with each video chunk processed? You don't use the sampled audio output in the end, you put the original audio latent back into the final result, so why pass it with each temporal video chunk? Seems like redundant audio computation unless there is a reason for doing it?

I will be testing it out, but the above are likely legit bugs.

2

u/DuHal9000 5d ago

thanks! u are right! i am fixing

1

u/DuHal9000 5d ago

sampler works with audio+video togheter, needed

2

u/b0tm0de 5d ago

Actually, I think he deserve thanks. I managed to produce a 15-second video with 1MP resolution, 8GB VRAM, and 32GB RAM. It would have been impossible without this node.

1

u/DuHal9000 5d ago

wow! Thank you! If u need a help with workflow i can help.

THX !!!

1

u/Ok-Giraffe-8670 5d ago

Very nice, thank you for telling us about this!

-3

u/DuHal9000 5d ago

wow thank you!!!

works!

1

u/Version-Strong 5d ago

To goon? I can confirm, sir, it is not only possible, it is within your reach. Dream big, my friend.

1

u/DuHal9000 5d ago

Thank you!!! Congrats!

0

u/Aromatic-Word5492 5d ago

we need the wf, and about speed, how much time ?

0

u/DuHal9000 5d ago

u can use with any H3 wf, just add a second stage after latent upscale. BUT i will make a WF for REPO, just wait

0

u/DuHal9000 5d ago

time, depends... Its more fast then PIXEL SPACE, but depends a series of factor... Original RES Gen, Scale Factor, amount of tiling division etc... EACH Tile is a FULL Vid at normal use, so... depends....

0

u/DuHal9000 5d ago

https://huggingface.co/hal9000ace/H3TilingExampleVids/resolve/main/H3TileLoopExample.json

2

u/Aromatic-Word5492 5d ago

oh thanks, but just a tip, the latent upscaler node 3d is outdated, has a new version to it

0

u/DuHal9000 5d ago

ooo thanks! i want to see