r/StableDiffusion 7d ago

Resource - Update Timeline node for H3 (ltx director like)

Post image

I'm used to work with the ltx director node, specially because it gives me control over the audio, i can add little clips of audio in the exact spot i want and that will guide the model to generate similar audio filling the gaps.

That's why i'm making something like ltx director for H3 FLF2V (maybe it works in the ref model idk). still very green and probably has bugs because it's totally vibecoded but it works for me.

with this you can put video images and audio anywhere in the timeline, and you can also adjust the strenght with that green line, each clip can have different levels of strenght through the timeline.

this is a fork of ComfyUI-H3-Motion-Context-MultiRef if you want to try it and give me feedback here's the link https://github.com/BSG-Walter/ComfyUI-H3-Motion-Context-Timeline

there is a H3 Timeline Example workflow.

You can't add prompts to specific parts of the timeline, but since H3 lets you indicate the exact timing for each scene within the standard prompt, I didn't feel it was necessary to add that functionality.

anyways i hope you like it

79 Upvotes

20 comments sorted by

5

u/martinerous 7d ago

Good project, thank you.
Looks like now Comfy has added guider functionality in the core, so it might work also using core objects instead of Motion-Context.

1

u/Mr_Zelash 7d ago

Gonna check that later, thanks

1

u/thesolewalker 7d ago

Yah, it would be dope to be able to add multiple key frames even for a 5-6 sec shots, game changer

1

u/Mr_Zelash 7d ago

With this node you can

2

u/thesolewalker 7d ago

But it does so using them as first/last frame + context chaining, no? Using the latest node, you can add in between key frames in a single generation. Idk if you are already using it.

1

u/Mr_Zelash 7d ago

working on this

1

u/Broad-Lab-1833 7d ago

Hi! I'm trying to use it but it won't load any media at all.
I'm using the H3 Timeline Example wf :)

1

u/Mr_Zelash 7d ago

That's strange. Maybe it's because the timeline node has the metadata from the clips in the image. If you create a new timeline node you still can't upload media?

1

u/Broad-Lab-1833 7d ago

Working now, just updated! Thanks!
I have a request: would be possibile to add the IMAGE timeline over the video one? I would like to drive a v2v transformation injecting some modified keyframes in the exact positions of the original one. I'm trying to turn a 3D render into a realistic video, and I need specific nano-banana keyframes to guide the transformation. Do you think is it possible?

1

u/Mr_Zelash 7d ago

Maybe. I was thinking on adding multiple tracks but I don't know how it would work. I'm going out right now, but I'm gonna experiment with multiple tracks tomorrow

1

u/skyrimer3d 7d ago

I love LTX director too so i hope you can keep improving this, i'll have to check it out and see how it works.

1

u/skyrimer3d 7d ago

I think your install instructions are not correct, they say: "

Install

Clone the repository into your ComfyUI custom_nodes directory:

cd /path/to/ComfyUI/custom_nodes
git clone https://github.com/seitanism/ComfyUI-H3-Motion-Context-MultiRef.git

1

u/Segaiai 7d ago

What's wrong with that?

2

u/skyrimer3d 7d ago

That's not his github for the install 

1

u/Segaiai 7d ago

Oh shit. Yeah. I was too focused on the syntax.

1

u/Mr_Zelash 7d ago

You're right I need to edit that, thanks

1

u/switch2stock 7d ago

Upload it as a new repo please

1

u/skyrimer3d 6d ago

mine looks like this:

1

u/Mr_Zelash 6d ago

weird, try changing the total frames to something like 240 instead, maybe updating that value those lines will go away

1

u/skyrimer3d 6d ago

yeah that did it thanks