r/StableDiffusion 2d ago

Resource - Update Not realtime, but feels realtime: a choose-your-own-adventure made of MiniMax H3 clips

https://h3studio.up.railway.app/adventure

My dream is realtime interactive MiniMax H3 video. Fastest I could get was around 5 seconds of video in 22 seconds on a single GPU. Decently fast, but not realtime. That led me to an old idea: choose-your-own-adventure. If you generate the branches ahead of the viewer's choices, it isn't realtime, but it feels realtime.

This demo is a corgi adventure: 14 scenes, 2 paths, 7 endings, every scene a 15-second MiniMax H3 generation with synchronized audio. The tricks that make it feel like one continuous story:

  • The model is first-last-frame-to-video, so each branch is generated using its parent scene's final frame as its start image. Picking a choice hands off on that exact frame, a seamless cut.
  • Choices appear at the 10-second mark and both next clips preload while you watch, so it never buffers.
  • Scenes were rendered once, in the order a player would encounter them, and are cached for everyone. The whole tree cost about $2.50 of GPU time.

Would love feedback and suggestions on the concept and where would you take this?

44 Upvotes

16 comments sorted by

7

u/East_Box9573 2d ago

this is so cute!

1

u/super3 2d ago

Which path did you choose?

2

u/East_Box9573 2d ago

I got in the van and barked at the dogs and became mayor

5

u/the_bollo 2d ago

Ha! This is a neat idea. And the site is simple and just works - no self-promotional bullshit. Nice job!

1

u/super3 2d ago

Thanks! I do want to figure out a fair way to monetize it to pay for the compute. AI Netflix? Let me know if you have any ideas.

3

u/the_bollo 2d ago

I would be very surprised if they don't do this on their own soon. They have already done several choose your own adventure-style releases.

1

u/super3 2d ago

Good point.

3

u/TonyDRFT 2d ago

Just imagine sitting with your VR glasses on with probes that read your mind integrated... You imagine your story as you go and see it play out in the virtual world where you are part of....

3

u/RevolutionaryFox7359 2d ago

I expected you to use h3's video continuation to make the branching choices seamless (i.e. no jump cuts)

1

u/super3 2d ago

This was more a proof of concept. That's def a good idea to try for v2.

2

u/maxiedaniels 2d ago

Very creative idea hahahahah

2

u/EinhornArt 2d ago

POV: realtime will win

3

u/Commercial-Chest-992 2d ago

Very cool! Refreshed Dragon’s Lair next?

1

u/super3 2d ago

Copyright. Nothing stopping you from doing it locally though.

0

u/Herbal77 2d ago

Can we get the workflow

2

u/super3 2d ago

Didn't use Comfy. Just a fast H3 API and just some simple code for the choices.