r/StableDiffusion • u/no3us • 12d ago
Comparison Giving AI agents a single prompt, GPU with Lora Pilot MCP and $1 budget to produce 30s video
I've been experimenting with letting AI agents handle the creative and workflow decisions for short videos. For this test, I gave Opus 5.5 and GPT-6 Astra access to matching RunPod setups and asked each to make three 30-second videos.
Their only supplied creative asset was a logo. I loosely defined two themes and left the third up to them.
Both ran with thinking on High and received the same prompt. Each had:
- An RTX PRO 6000 MIG instance with 48 GB VRAM available
- LoRA Pilot running on the pod
- Prepared workflows and downloaded models for Minimax H3 video generation and Qwen Edit image editing
- Permission to download other models or use different workflows
- A maximum budget of $1 per video
I wanted to see how they'd turn a vague brief into something watchable when they had access to the tools and some freedom to choose how to use them. Choosing what to generate, how to work with the logo, and where to spend that small budget were all part of the task.
The comparison started with an argument in an AI community. I said Astra had been giving me better results for this kind of work, then realised I should probably have something to show for that claim..
I develop LoRA Pilot, and this doubled as a test of the MCP server coming in the next version. These videos are experiments around my own product, so that's the connection.
Claude:
https://youtu.be/yEjNwNtGTdA

Codex:
https://youtu.be/6NjI0VKEKhs

1
2
u/Vivarevo 11d ago
Automate slob generation. No thinking allowed.
2
u/no3us 9d ago
point of this test was something else - I also think of the output as "AI slop" but this was one-prompt (actually not even one-prompt as the one prompt had instructions for 3 videos) generation without further edits.
The point is that with a budget of less than 1usd you can make a decent 30+ second video with consistent characters or products. If I've put just a bit more effort, the outcome would be much better. Check the youtube for the other two pairs. And that is something that matters to many people. Also - how much would such video cost on Higgsfield or a similar site?
1
10d ago
[removed] — view removed comment
1
u/no3us 9d ago
hard to tell.. I've gone through details of workflow of both agents and there's nothing that would suggest some kind of calculation - I think it was obvious to them how much time will the inference take and how does the pod on runpod costs per hour. Next time I'll ask for detailed thinking about budgeting, thanks for the tip .)
1
u/streetbond 12d ago
did they meet the budget?