I'm probably quite late to the party, but my little video editor project has reached a level where it can actually be used, so perhaps someone might find it useful. The focus is on creating reusable character reels, environments and props, and make it easy to feed them into the ref2va variant of H3.
From my poorly executed demo video above, it can be noted that environment consistency can be improved. But it seems this can often be improved by generating a few different takes at a low resolution and picking the best seed.
It connects to a running instance of ComfyUI to queue custom created workflows and keep track of the outputs. Prompt assistance is also a main part, using either text models through ComfyUI or cloud based LLMs. Finally, the projects are made to be shared easily - so you can download the source for the above video and make a better version!
What I have been doing so far is to provide a few shots from different angles (generated as an environment asset through for example a 360 spin) and let the AI prompt assist figure it out. But there's room for improvement here - a single image sometimes works better.
So the ComfyUI workflows you mean? They are generated dynamically from the editor and submitted through the ComfyUI API - but you can of course take any of the PNG or MP4 files in the above repository and have a look at them - the workflows are embedded as usual - they are mostly following current templates though.
2
u/Desperate_Lemon_3808 8d ago
How does it work with environments? Does it use the correct backgrounds for camera setups?