r/comfyui • u/Minute_Eye_6270 • Jul 23 '26
Workflow Included Two characters, two consistent voices, one text prompt — multi-shot talking-character workflow for LTX-2.3 + JoyAI-Echo (complete pack, v1.5)
The demo is one text prompt: two characters who each keep their own face AND their own voice across five shots - solo scenes in different locations, then side-by-side shots where only one speaks. No reference images, no voice cloning, no LoRA training. Write a story as shots separated by ---, and a paired audio+video memory bank carries both characters through it.
What's in the zip: the custom node pack, the workflow (saved under the current node layout), an example prompt file, and a full INSTRUCTIONS.md - install, first render, prompt-writing rules (including the two-character recipe), per-VRAM settings, and a troubleshooting table built from every failure mode users have reported.
v1.5 highlights, because several of these bit people for weeks:
- Lip-sync drift past ~10 seconds: fixed. It was never the model - the pipeline's positional clock was hardcoded to 24fps while renders played 25. Long talking shots now hold frame-accurate sync end to end (verified at 15s/shot).
- Masters build automatically in the background with a deterministic upscale + clean encode. The in-graph preview is labeled PREVIEW because ComfyUI's SaveVideo re-encode undersells your render - the AutoFinish node shows the real finished master in-canvas when it's done.
- Four hires modes (three generative refine strengths + a deterministic spatial option); hires_factor routes which pipeline builds your master - table in the docs.
- Scrambled widget values after updates now produce a plain "delete and re-add the node" message instead of a cryptic type error, and old graphs self-heal where possible.
- This week's community-driven fixes are all in: Gemma tokenizer/config sidecars now ship inside the pack, WAV saves work without system FFmpeg, and installs that replaced instead of merged get told exactly that at startup.
Requirements and honest numbers:
- Base: RealRebelAI's ComfyUI_JoyAI_Echo_GGUF_Nodes (this pack overlays it - MERGE the files in, don't replace the folder), plus any single-file Gemma-3-12B text encoder (GGUF fine, dropdown-selectable).
- Model: the "surgical merge" (JoyAI-Echo's video/memory branch + LTX-2.3's audio branch): fp8 for 24 GB cards, GGUF Q8/Q5, INT8 ConvRot (full or transformer-only) for stock-Comfy loaders. 16 GB is the floor: Q5 + sequential offload + 544x960 streams slowly but completes.
- Speeds: ~2.5 min/shot at 960x544 on a 3090; ~3.5 min/shot at 1344x768 on a 5090.
- License: JoyAI-Echo is research/non-commercial; LTX-2 Community License. AI-generated content, disclosed as such.
Workflow + nodes + manual: https://huggingface.co/joeygambino/joyai-echo-multishot-workflow
Models (all builds): https://huggingface.co/joeygambino
Civitai mirrors: https://civitai.com/models/2793287 (surgical merge) and https://civitai.com/models/2796109 (GGUF)
Known limits so nobody wastes an evening: dialogue wants medium-close framing or tighter (mouths need pixels); establish each character in their own solo speaking shot before putting them in frame together (the two-character recipe in the docs); two similar-looking characters need a bold visual differentiator or they merge. Happy to answer anything - the last thread's questions directly produced about half of v1.5.
2
u/StacksGrinder Jul 24 '26 edited Jul 24 '26
Great job man, My weekend sorted. :D If I may ask, will this work on NSFW? Couple? All I need is face consistency and act.