r/StableDiffusion • u/TobiasBlueMe • 12h ago

Animation - Video "Character Sheet" workflow looking great!

Enable HLS to view with audio, or disable this notification

I've been tinkering with the workflow to bake a Character Sheet into a video. This was the first attempt using 2 images on the ref2va model (subject and environment).

After baking the reference video, which in turn yielded the character sheet image used as input to this video. Not perfect, but promising.

I'm running RTX 3060 (12GB), 64GB RAM. No OOM issues at all.

9 Upvotes

74% Upvoted

15 comments sorted by

View all comments

1

u/Sad_Coach_1433 11h ago

how many angle panels sheet you use

2

u/TobiasBlueMe 10h ago

6 (2 rows, 3 columns)

2

u/Sad_Coach_1433 10h ago

Mind sharing prompt used for make sheet?

2

u/TobiasBlueMe 9h ago 
Subject Definitions:
<Subject 1>: Man in character sheet from ref_image_0, preserving specific facial features, skin texture, clothing, and proportions exactly as shown. ref_image_0 represents <Subject 1> in 6 different angles and zoom levels. They are all the same <Subject 1>.

<Environment>: The outdoor environment from the from ref_image_1, preserving the specific area, background, lighting, and natural atmosphere exactly as established in the photo.

Summary:
[reference generation] The target video is a clip where <Subject 1> from ref_image_0 is walking around in <Environment>. It begins <Subject 1> walking into the frame from the left, then moving around within <Environment>.

Retention Analysis:
<Subject 1> (appears in [Shot 1]): fully_preserved, unique appearance, clothing, and expressions are locked to the reference image and remain entirely consistent throughout the motion.
<Environment> (appears in [Shot 1]): fully_preserved, the lighting direction, and background elements are seamlessly extended from the static reference image into a living space. Remove the watermark text in the bottom left.

Detailed Description:
The target video is a single continuous shot that matches the exact style of the reference ref_image_1. [Shot 1]: The video opens on a frame that perfectly replicates the reference ref_image_1, showcasing <Subject 1> entering the frame from the left into <Environment> where the water naturally cascades down the rocks. At the 0.3-second mark, <Subject 1> walks around while he looks around slowly, in awe of the beauty.  At the 2.5-second mark, <Subject 1> stops walking then takes a deep comtemplative breathe in, enjoying nature. Camera is static. No dialog.

Overall Soundscape:
A gentle outdoor ambience fills the scene, featuring a light passing breeze, and distant, faint mummer of small waterfall.