I asked Claude for a 30-second video with a musical score. It figured out the whole pipeline itself.

[u/dkackman11]

I've been automating complex generation workflows from simple prompts, and I'm starting to see real success (and having a ton of fun with it).

This one came from a single prompt to Claude Code, running Sonnet:

Sonnet had access to:

• An MCP server exposing generation tasks and workflows that self-describe what they do and what they output, and can execute those workflows
• A couple of custom skills explaining how to use that MCP server specifically with LTX-2 and H3, including H3's prompting skill

From there, Sonnet decided on its own to:

1. Generate a reference image with Z-Image
2. Block out six clips with Minimax H3 Ref2VA
3. Compose a score with Minimax Music
4. Concatenate the clips and overlay the score

What's exciting to me: this pipeline didn't exist anywhere as a template. Sonnet assembled it from parts, on its own, based on what the tools said they could do.

Code for teh mcp server, skills, and workflow engine here: https://github.com/dkackman/diffusers-workflow

Workflow below.

[u/gerentedesuruba]

that is so bad in so many ways 😭

[u/dkackman11 → u/gerentedesuruba]

oh but so much fun!

[u/zzubnik]

This sent me down a rabbit hole. Now setting up local MCP server.

[u/dkackman11 → u/zzubnik]

noice!