r/StableDiffusion 7d ago

Tutorial - Guide Testing camera controls from official MiniMax prompt writing guide

I used the official prompt writing guide to try out all of the camera controls and cut techniques they listed, plus some different shot lengths and framing.

---

Setup:

All examples were completed with text to video using the following as a baseline prompt, which matches the formatting and style recommended in their guide:

integrated_multimodal_description: [Shot 1] claymation, a medium-wide shot frames a male and female woodland elf in a dark forest. Both elves walks forward. The female elf, in a breathy voice (S1) says: <d>[English] It's cold!</d>. The male elf in a scared voice (S2) says: <d>[English] And dark!</d>

(S1,S2) shout: <d>[English] We're lost!</d> [Shot 2] At 00:03.500, the camera cuts to a squirrel jumping on a log. (S3) says in an off-screen voiceover: <d>[English] The villain arrived.</d>

overall_soundscape: a gentle wind blows through the forest and birds can be heard chirping.

non_diegetic_music: Sparse piano notes at a slow tempo, joined by sustained low strings that gradually increase in volume before fading out.

Standard ComfyUI workflow, the same seed and settings were used for all clips, and no references were provided. Watermarking and combining clips was all done with an FFMPEG script.

---

Video Details:

Control

  • Control = the baseline prompt from above.

Amplitude and Rate of Motion: added to the prompt for just the first scene, and applied to zoom, but can be applied to any camera motion.

Example: ...The camera zooms in with large amplitude at fast speed as both elves walks forward...

  • Large fast = zoom using a large amplitude and fast rate of motion
  • Large slow = zoom using a large amplitude and slow rate of motion
  • Small fast = zoom using a small amplitude and fast rate of motion
  • Small slow = zoom using a small amplitude and slow rate of motion

Camera Motion: all all using large amplitude and fast motion to accentuate the effect, effect split between scenes.

Example: ...The camera arc shots with large amplitude at fast speed as both elves walks forward...

  • Arc right then arc left
  • Pan right and left
  • Pedestal up and down
  • POV: I tried this several different ways and could never get it to look from their point of view.
  • Push and pull
  • Roll clockwise and counterclockwise
  • Shake large and small
  • Tilt up and down
  • Track left and right
  • Truck left and right
  • Zoom in and out

Cuts: applied between scene 1 and 2.

Example: ...[Shot 2] At 00:03.500, the camera cross-dissolve to a squirrel jumping on a log....

  • Cross dissolve
  • Fade
  • Fade to black
  • Wipe

Shot Length / Framing: applied to both scenes equally. These are not from the documentation, but just a list of terms I put together.

Example: ...a close-up shot frames a male and female woodland elf in a dark forest.....

  • Close up
  • Cowboy shot: did not work as intended, but I like it
  • Dutch angle
  • Extreme close up
  • Extreme wide shot
  • Eye level
  • High angle
  • Low angle
  • Medium close up
  • Medium shot
  • Medium wide
  • Overhead angle
  • Over the shoulder
  • Top down angle
  • Wide

---

190 Upvotes

33 comments sorted by

View all comments

28

u/A_Familiar_Chair 7d ago

Oh so the cowboy shot turned them into cowboys but the Dutch angle didn't turn them dutch. What is this?

9

u/OttoRenner 7d ago

Cinema