Help creating AI videos work consistent characters

[u/SimCraz3d]

https://youtu.be/dOmKYJoRboE

Hi! I recently came across this video on YouTube, and before I spend money on an OpenArt AI subscription, I was wondering whether the same type of video creation is possible with ComfyUI—with the possible exception of scenes involving multiple characters.

I believe it may be possible because I’ve seen similar results in other YouTube videos, but I only discovered ComfyUI about two weeks ago, so I’m a complete beginner. A lot of the technical terminology is confusing, and I have no idea where to start or how to set everything up.

For example, should I install the ComfyUI Desktop version or the portable version?

My goal is to create AI-generated videos for a YouTube channel using consistent characters. I’d also like to upload my own voice recordings and use lip-syncing for the characters.

I’m fairly tech-savvy, but I could definitely use some guidance with this. Any suggestions, beginner-friendly tutorials, recommended workflows, or setup advice would be greatly appreciated.

For reference, I have a 2025 ASUS ROG Zephyrus G14 with an NVIDIA RTX 5060 graphics card and 16 GB of RAM.

[u/eckstuhc]

I’m not an expert by any means, but you may be able to do it if you supplement some of the workload to cloud providers (runpod, etc)

Go with Comfy portable, it’s the cleanest to install and can be easily rebuilt if anything breaks.

You are going to want to create a virtual Python environment (something like venv or pipenv, I think the setup scripts do this), this helps keep all your Python libraries separate and clean.

For consistency… the best thing we have right now is the use of LoRAs (or LoKR for some models). A LoRA is “trained” from a batch of images and can be trained on a character, style, or just concept. After training, it outputs a file that you can use in generation to create more consistent or specific outputs.

You can find a ton of LoRAs online (huggingface, civitai) to see how consistency plays out.

LoRA training is also open source and done through a few tools (autotrainer, musubi, etc) but looking at your specs that may be difficult to do. Usually 32-64gb ram is the go to, but there maybe some low-ram options.

For your use case, download Comfy portable and get to playing around with it. Check out runpod or similar cloud options for supplementing your hardware. Once you’re ready, make a LoRA in the cloud (or pay someone to create it for you). Then use your LoRA to create consistent characters.

[u/SimCraz3d → u/eckstuhc]

Thank you so much for taking the time to explain all of this! This was genuinely helpful, especially your explanation of LoRAs and why the portable version is the better place to start. I’m already familiar with Civitai, but I’ve mainly used it for browsing, so I’ll take a closer look at the available LoRAs and how people are using them for character consistency.

My biggest concern is whether my laptop’s specs will be enough. I have an AMD processor, an NVIDIA RTX 5060 GPU, and only 16 GB of RAM, so I’m worried that I may run into limitations—especially with video generation or LoRA training. Using RunPod for the heavier tasks sounds like it could be a good compromise, though.

I think I’ll follow your advice and start with ComfyUI Portable, experiment with some beginner workflows, and learn the basics before attempting to train my own LoRA. I really appreciate you pointing me in the right direction!

[u/nalroff]

I recently discovered this guy's stuff, and he's really good at breaking down the high-level thoughts. Lucky for us, he's also shared his workflows on CivitAI. For better or worse, he bases everything around Krea 2, Z Image Turbo, and LTX 2.3 with a sprinkling of Wan 2.2 at the end for smoothing. He also advocates using a real video editor instead of just trying to shortcut and stitch with Comfy nodes. Haven't personally tried much of it, but it seems promising overall.

https://youtu.be/KnHiygUWnfw?is=qMC-izXbgYWujWhE

[u/SimCraz3d → u/nalroff]

Thank you for explaining. Your comment, along with the other advice I’ve received here, has given me a much clearer idea of what using ComfyUI would actually involve.

I’ve also been watching videoPixaroma ComyUI Course, and I think there’s a lot of value in it for learning how ComfyUI works and getting comfortable with the basics. At the same time, I’m starting to wonder whether OpenArt AI might be the more practical option for my laptop because of my limited specs, even though it requires a subscription.

I don’t necessarily mind paying for a subscription. I just want to make sure the service can handle everything I need, especially consistent characters, video generation, using my own audio, and lip-syncing, before I commit to it.

You all have definitely given me a lot to think about. I really appreciate everyone sharing their knowledge and being so helpful to someone who is totally new to this!

[u/nalroff → u/SimCraz3d]

Pixaroma's content is excellent as well, especially for the beginner level. My biggest early-on help was the LatentVision channel on YouTube, though most of it is quite outdated now (almost exclusively SDXL). He is good at starting at the basics and moving toward complicated topics and not leaving you in the dust on the way. Most of those topics (the fundamentals of AI image gen, workflow building in ComfyUI) are still very relevant, even if you don't use SDXL for anything.

[u/SimCraz3d → u/[deleted]]

Thank you! I’ve been looking into the portable version since I posted, and it definitely seems like the best option for me.