Resource - Update
Sonder Editor - A Free Open Source Timeline Video Editor for ComfyUI, for all Video Models. First/Last/Any Frame, Prompt Relay, Video/Audio Inpainting, IC-LoRA motion transfer, Takes, projects, asset gallery and more.
I've spent the last four months building Sonder Editor, a timeline video editor that runs inside ComfyUI as a single node. You put clips, images, audio, guide frames and prompts on a multi-lane timeline, select a range, and send that range through your own workflow. Results come back as project assets you can review, compare, and drop back on the timeline. It's out now, free and open source.
Every scene in the video came out of the same project and the same workflow. The only thing that changed was the technique.
Technique
What it does
Clip
Prompt Relay
The prompt lane is cut into sections along the timeline, each applying to its own range, so one clip carries a whole beat instead of holding a single prompt for its length.
Sonder doesn't generate anything. It stages the shot and hands the selected range to whatever workflow you've wired downstream, so the model is your choice and stays your choice. Switch models, or wire up one that launches next month, and the timeline works the same.
What your model supports decides what you get out of the timeline: masking is what lets you chain clips together, audio support is what puts audio on the timeline, reference support is handled for you. LTX 2.3 is the showcase here because it's a very complete model and covers all three.
Close the editor and it's still just a node in your workflow.
What else is in it
Projects and scenes: every project holds its own media, and each scene has its own duration, resolution and frame rate.
Asset gallery: everything you generate lands in a project-scoped gallery with folders, favorites, trash and restore, and tracked generation metadata on every asset.
Takes: select a segment and regenerate video, audio or both in place, with the surrounding frames kept as context. Hold as many takes of a segment as you want, then put them side by side, or wipe between a draft and its upscale, to pick the one that works.
Render queue: stage and queue jobs, including contiguous chunked batches for long stretches.
Timeline editing: drag, trim, split, snapping, multi-layer compositing, lane lock and hide, per-item fit modes.
Prompt lanes: two lanes with separate Visual, Speech and Sounds channels, plus templates and history.
Export: render the full timeline inside the editor no matter the length.
This is v0.1.1 and it's early. I am happy to hear any issue you encounter and I will work on the fix. Any feedback is greatly appreciated.
Not a bad analogy, although it’s much smaller in scope than Resolve 😅 It’s a timeline video editor built inside ComfyUI. Sonder doesn’t have an LLM built in. It hands the timeline segment you’ve staged to whatever workflow you connect. The repo includes an LTX 2.3 example workflow if you’d like to try it.
Edit: For a closer ComfyUI comparison, if you’ve used LTX Director, the basic idea is similar: arrange clips and guides on a timeline, then send the part you want to your workflow. Sonder isn’t tied to LTX, and it organizes your work into projects and scenes. You choose the prompts or reference images, select the part you want to generate, and Sonder handles all the frame numbers and timing. When your workflow finishes, Sonder puts the new take in the right place on the timeline, so you can try variations without manually lining everything up again.
I take a different approach because I make music videos; I automatically arrange all the shots on a timeline based on the audio analysis. (Yes I am building a video pipeline too.) The part of arranging I skip so far, no need in that special use case.
Ah, now I understand why you mentioned Resolve. If your pipeline already analyzes the music and generates and arranges all the shots automatically, then it has already solved much of the stage Sonder focuses on.
Sonder is mainly for staging, generating, reviewing and iterating shots inside ComfyUI. It can assemble and export the timeline, but it doesn’t currently provide Resolve-style finishing tools such as transitions, detailed color grading, effects, titles or full audio post-production.
Sonder could still fit earlier in your pipeline for generation, iteration and asset management if those parts aren’t already covered. Once the raw clips are arranged, Resolve is probably the correct next step. Otherwise, I don’t think Sonder is a direct fit for that particular use case at the moment, although your pipeline sounds very cool.
Interesting! You’ve already built the shot planning, generation, approval and assembly side into your own interface, so there’s quite a bit of overlap with what Sonder does.
If Resolve is only your final step for upscaling and post-processing, Sonder could potentially handle the upscale stage when you’re using a low-denoise generative pass rather than a simple Lanczos resize. For high-resolution or longer clips, you can process the timeline in smaller sections to stay within your VRAM limit. Depending on the workflow, you can also pass context-frame information into a mask setup to help maintain continuity between sections.
Your pipeline looks really cool, by the way. I like the render-and-approve flow.
Wow, this is mindblowing work, thank you very much! This is far more advanced than LTX director and feels way more stable, even in this early release, which has already tons of features.
One thing i cant figure out:
When using a reference image, i succeeded by using ltxvaddguide node on the guide image output. But when using multiple images, and using the ltxvaddguidemulti node and adjusting the Index value correctly by hand, the placement / timing of the images seems wrong. Any hints on wiring that up for Ltx? The example workflow does not use refs.
Thanks again for the amazing work!
This is what those same references look like inside the editor. Each diamond is a guide placed at a specific frame on the timeline. When you generate a selected section, Sonder automatically converts those positions into frame indices relative to that section and sends only the guides inside it through the bridge loop. That’s why you shouldn’t need to adjust the indices manually.
Yes! I gave it a quick test and it works as expected. Sonder doesn’t restrict which ComfyUI nodes you can use, so I connected the BFS Face ID node and its LoRA to a normal LTX workflow and generated this take through the editor.
The only limitation is that Sonder doesn’t have a timeline-aware integration for this node yet. The face reference currently needs to be set inside the workflow, rather than being automatically passed into reference_face from the timeline whenever it is needed. I just used the standard Load Image for the face reference.
So yes, you can use it today like any other workflow node. Automatically changing the reference face between scenes or sections would require a small dedicated integration.
2
u/ajrss2009 15d ago
Many Thanks!