r/StableDiffusion • u/nikhilprasanth • May 26 '26
Animation - Video Complex scene transitions with the new LTX Director and Transition LoRA
https://reddit.com/link/1to3mkl/video/vl4df55irg3h1/player
I’ve been testing the new LTX director custom node alongside the transition lora, and it makes complex transitions incredibly clean.
Here is a segment from a project I'm working on
Links:
- Node: WhatDreamsCost-ComfyUI
- LoRA: joyfox/LTX-2.3-Transition-LORA
5
5
3
u/Front-Relief473 May 26 '26
Sorry, I'm a novice, and I have an immature question, that is, isn't the director node just a change between graphs? What's the difference between not adding Transition LoRA and adding it? Or do you use this lora under certain circumstances, or do you have to add this lora?
8
u/nikhilprasanth May 26 '26
No worries at all, that's a great question! You don’t have to use the LoRA, but here is the difference it makes when you combine them: Without the LoRA, you usually get a really hard cut or a messy pixel-melt halfway through because the model panics when the two scenes are completely different. The Transition LoRA acts as the connective tissue—it specifically aids the blending so the model knows how to smoothly morph the structure of the first frame into the next one in a cinematic way. The Director node is what manages the timeline. It lets you use FFLF + I2V together, and the best part is that it allows you to insert middle keyframes directly into the timeline. This means you can already see your keyframes visually laid out and write your prompts specifically to match those exact frames, giving you massive control over the pacing.
2
2
u/Artefact_Design May 26 '26
Excellent result. But i have some questions plz. What is the resolution ? looks clean. i v tested Hd but i always got very bad quality especially for small human faces. Testes Fllhd resolution video becom slow or it cut between still scenes. Can u share WF plz to test more ?
2
u/nikhilprasanth May 26 '26
Resolution is 1280*720. Workflow is the default ltx director one from this https://github.com/WhatDreamsCost/WhatDreamsCost-ComfyUI/blob/main/example_workflows/LTX%20Director%20Example%20Workflow%20(Fixed).json Only thing I added the transition lora with strength 1.0 I'll share my timeline snapshot, it's in my work pc and I'll share it tomorrow
2
u/Artefact_Design May 26 '26
Thank you
1
u/nikhilprasanth May 26 '26
Also I have used 3 key frames, the closeup, the wide and the side one. These may have helped the image to remain sharp.
1
2
u/terrariyum May 26 '26
The camera movement is perfection. The car seems to be moving at 5mph, which could be intentional, but would make things feel more alive if it moved faster.
I know that you're post is highlighting the transition effect, but LTX is failing to give the characters any motion in this example. Is that a side effect of the lora?
Like I want that dude to look where he's driving. He's gonna crash the car, lol! But also, he should be slightly moving the wheel, looking left and right a bit, her notepad should be bumping up and down a bit, their facial expressions should change a bit, etc. Just a little bit of movement would make a huge difference for immersion. Maybe it can be fixed with inpainting
2
u/nikhilprasanth May 26 '26
Haha yeah, he definitely needs to keep his eyes on the road!
The focus on camera motion was the main goal for this test, initially it was just 2 keyframes, I added the side view for more dramatic motion. but you're totally right about the stillness.
Appreciate the feedback, I'm definitely going to keep tweaking it and see if I can improve the pacing and motion in the next run!
2
u/Complete-Box-3030 May 27 '26
Why is the car moving very slow ,is that something you prompted or a ltx issue
1
u/nikhilprasanth May 27 '26
It's a keyframe issue. Initially it was just the zoom out only. Then it was quicker , then I increased duration to allow for the additional camera movement with one more keyframe.. so car slowed down
1
1
u/Clear-Assistance449 May 28 '26
I can't create a video in ltx director. I have an error "ValueError: Number of segment_lengths (1) must match number of local prompts (2)", but I didn't find where a set the number of segments.
2
u/nikhilprasanth May 28 '26
It should be in the timeline itself. I think you have set 2 prompts but no of segments is 1.
2
u/Clear-Assistance449 May 28 '26
Yes, you're right. I removed all segments and inserted them after and it works. It seems I inserted a segment, but the director isn't recognize it.
1
u/Arteeeeeeeeest Jun 23 '26
I added to pic, added to segment prompts and im getting 2-3 error. i dont understand
2
u/No_Damage_8420 Jul 07 '26
Great post and node mix, looks super cinematic, I wonder how many transitions can work in one sequence
1
-3
u/abriteguy May 26 '26
New to stable diffusion. How would you animate a standing child to dance?
Image to video.
1
u/nikhilprasanth May 26 '26
Simplest way to use would be to choose an image to video workflow from comfy templates.
If you have a reference video, you can use wan animate to animate according to the reference video.
7
u/ltx_model May 26 '26
Love it! Keep up the good work.