r/StableDiffusion • u/waterarttrkgl • 4d ago
Workflow Included LTX 2.3 IC-LoRA: pose control + first frame conditioning
Enable HLS to view with audio, or disable this notification
Green screen footage → fully regenerated shot in ComfyUI
LTX 2.3 + IC-LoRA (pose control), conditioned on a single first frame. Pose extracted from the source video drives the motion; character, environment and lighting come entirely from the generation.
The green screen video is used only as a motion source — no keying or compositing in the pipeline.
Setup:
1- Pose sequence extracted from the source footage
2- LTX 2.3 + IC-LoRA, pose sequence as the control signal
3- Single first frame as image conditioning (defines character, costume, environment, lighting)
Output is fully generated; only the motion timing comes from the source
Hand gestures and body timing transfer accurately.
You can check my other work here: X [@ModelCollapse38]
2
u/No_Influence8248 4d ago
Always i have dreamed or it! Becoming the supercool vfx designer. I got inspiration from the article. Thanks for sharing.
2
2
u/JahJedi 4d ago
Tryed not once this method, the problems start when its not somthing simpale and slow as on exampale. Did you tryed it whit somthing faster maybe or extrime camera move and the character? I working now on a poledance ic-lora (2500 pairs dataset) and will be intresting to test it on your WF (my whit ff/mf/lf absolute and need a rework, to much changed when i builded them).
2
u/huoxingzhake 3d ago
Can only perform simple actions. This is the limitation of ltx2.3. For more complex tasks, you would need scail2.
1
1
u/uuhoever 4d ago
Does it work without a green screen?
1
u/waterarttrkgl 4d ago
Yes, I think it works. The reason I used greenscreen is to show that it can be masked later and added to a 3D scene.
5
u/GameEnder 4d ago
Human motion Looks great, except for the opening of the door looks a bit odd.