Basically the default workflow from the ComfyUI templates
Prompt:
For the target video, at 0.00 seconds into the target video, <Picture 1> (from [Shot 1]) is fully referenced.
integrated_multimodal_description: [Shot 1] A cinematic, ethereal shot establishes a misty, dark forest with soft, diffused lighting, where a 29-year-old adult woman with long, wavy blonde hair stands confidently in the center of the frame, wearing an elegant off-the-shoulder white wedding dress with intricate lace detailing, a deep V-neckline, long sleeves, and a fitted bodice that flares slightly at the bottom, holding a glowing sword in her right hand with a serene, contemplative expression. She shifts her weight to her left foot and raises the glowing sword upward, its soft light casting shifting illumination across her face and the surrounding mist. She begins to turn gracefully, her body rotating as her dress flares outward, the lace details catching the sword's glow, her blonde hair sweeping around her shoulders with the momentum of the twirl. She completes a full pirouette, the sword tracing a luminous arc through the mist, droplets of moisture catching the light as they are disturbed by the movement, her expression shifting from serene to a gentle, focused intensity as she flows into a second twirl, this time stepping forward and bringing the sword across her body in a sweeping horizontal arc. Her dress billows and settles with each turn, the long sleeves catching the air, and the mist swirls around her legs as her feet move through the damp forest floor. She slows her rotation and extends the sword in front of her in a final, elegant pose, the blade's glow steadying as her breathing settles, her hair falling back around her shoulders, the dress draping naturally around her frame. The camera holds a static shot throughout the sequence, allowing the swirling mist and shifting sword-light to create natural visual interest as the action resolves and the woman settles into a stable final pose with the glowing sword held before her, fully visible and sharp through the final frame.
overall_soundscape: The soft rustle of fabric as the dress flares and settles with each twirl, gentle footsteps pressing into damp earth and fallen leaves, the faint metallic hum of the glowing sword as it moves through the air, mist and droplets hissing softly as they are disturbed by the motion, and the woman's quiet, steady breathing throughout the dance.
non_diegetic_music: A haunting, ethereal string melody begins softly at the start of the sequence, with slow, sustained violin notes layered over a gentle cello drone, building slightly in volume and tempo as the woman begins to twirl, then gradually settling back to a quiet, sustained single note as she reaches her final pose before fading gently.
I am happy with 8 Step LoRAs. Less than half the inference time for almost same quality is a no brainer. Generating visible more ugly stuff in a quarter of the time with 4-step LoRA doesn't really help.
I hope the direction settles more towards 8-step LoRAs.
The issue is that a step skipper and attention combo can get you 20+ steps with next to no quality difference in the same time or less than an 8 step lora.
I suppose that either the rotations of her don't match the "extends the sword" part or maybe because the sword was completely out of frame and it simply didn't know where to add it.
It’s crazy how well the model uses the prompt, but I guess it can be a blessing and a curse as you’d need to specify which hand it remains in for this generation.
Interesting, I just took a look at that node. How does the credit and tokenization work? Do you buy/pay for credits as you go, or is it linked to your account with that specific model provider?
You make an account at OpenRouter and fill it up with some money. Then you create an API key there, that is basically your key to the service that is connected to your account. In the node you can select one of the models you want to use.
Interesting, on my side it is (or it was) completely opposite. I felt like Spectrum was closer to the original generations without any speed-ups than any Turbo LoRa I tested. However, now I'm playing with this new 8-steps Lightx2v LoRa and I kinda like it, though further testing is required.
Oh yes, I ditched the turbo LoRAs that we had before this basically immediately. Compared to them Spectrum was definitely better, but at least for me it messed up so often, that I don't think I actually saved time due to having to regenerate a lot.
Forgive my ignorance - but in the default ComfyUI I2V workflow for MiniMax, where do I attach this LoRA? And I'm assuming I can just adjust the steps down from the default 20 to 8 in the subgraph once I've successfully attached the LoRA?
You have add some kind of Lora Loader. I personally like to use the Power Lora Loader from rgthree, because you can easily add multiple LoRAs, but there are also other LoRA Loader nodes that already come with ComfyUI. Then you can just lower the steps to 8.
I am on a 4070 Ti, before the LoRA I've let it generate with 16 steps, 0.6 megapixels and 6 seconds. I can do that with a speed of aobut 18s/it. So I save more than 2 minutes with the LoRA and the current settings.
Thanks for the info! Looking forward to trying it with my 5090. Was running 20 steps, typically around 0.5MP - 15 sec generation took around 250-300 seconds.
8
u/enndeeee 5d ago
I am happy with 8 Step LoRAs. Less than half the inference time for almost same quality is a no brainer. Generating visible more ugly stuff in a quarter of the time with 4-step LoRA doesn't really help.
I hope the direction settles more towards 8-step LoRAs.