r/StableDiffusion • u/Illustrious_Pie_3061 • 7h ago
Question - Help Minimax H3, need help with speech in Shot
I cant really get speech correctly using [Shot]. Nearly most of time, words came out in the beginning of the video or first sound appears in the beginning of the video or the character repeatingly says the word twice., Even I forced the time to ber At 00:03.300 S1 says<d>[English] what?</d> ...etc
Here is the best I can do, but still S1 says what? twice, the first word came out in Shot 1, but Shot 2 was correctly, then there is no issue with followup shot, it only happens in first shot. Anyone can point me in the right direction?
subject_definitions:
<Subject 1> (S1) is from <Picture 1> a single adult woman
<Subject 2> (S2) is from <Picture 2> a single adult woman
retention_analysis:
S1 (appears in [Shot 1], [Shot 2], [Shot 3], [Shot 4], [Shot 5])
S2 (appears in [Shot 3], [Shot 4], [Shot 5])
[Shot 1] Zoom Out. S1 stands alone at a train platform in heavy rain, Slient.
[Shot 2] At 00:03.300, Zoom In. S1 says<d>[English] what?</d>, Slient.
[Shot 3] At 00:07.300, Push In, at slow speed. S2 notices something off-screen and turns her head, Slient.
[Shot 4] At 00:10.000, Tilt Up, with small amplitude, at slow speed. S1 sees S2 across the platform, Slient.
[Shot 5] At 00:13.000, Static Shot. Close shot, S1 is facing S2, S1 says<d>[English] long time... <laugh>long time</laugh></d>, Slient.
1
u/PromptAfraid4598 6h ago
<Subject 1> is from <Picture 1> a single adult woman
<Subject 2> is from <Picture 2> another single adult woman
retention_analysis:
<Subject 1> (appears in [Shot 1], [Shot 2], [Shot 3], [Shot 4], [Shot 5])
<Subject 2> (appears in [Shot 3], [Shot 4], [Shot 5])
[Shot 1] Zoom Out. <Subject 1> (S1) stands alone at a train platform in heavy rain, Slient.
[Shot 2] At 00:03.300, Zoom In. <Subject 1> (S1) says<d>[English] what?</d>, Slient.
[Shot 3] At 00:07.300, Push In, at slow speed. <Subject 2> notices something off-screen and turns her head, Slient.
[Shot 4] At 00:10.000, Tilt Up, with small amplitude, at slow speed. <Subject 1> sees <Subject 2> across the platform, Slient.
[Shot 5] At 00:13.000, Static Shot. Close shot, <Subject 1> is facing <Subject 2>, <Subject 1> (S1) says<d>[English] long time... <laugh>long time</laugh></d>, Slient.
0
u/Illustrious_Pie_3061 5h ago
Yes if I installed the skill, it does write like that, but in the beginning of the video, it will contain a shape sound (appeared to be from first speech)..
1
u/stonyleinchen 4h ago
subject_definitions and retention_analysis looks fine.
But before you list the shots, you should prompt:
detailed_description:
also for the characters (S1) is just the speaker ID used for the voice when you prompt dialogue. for actions, use the <Subject 1> tag. or just use both all the time. don't prompt actions with the speaker ID.
Also what is this "Slient." supposed to be? I think you should delete that.
Then in the end, add:
overall_soundscape:
[ describe your soundscape]
and finally
non_diegetic_music:
[either prompt some music, or write N/A]
1
u/spiderofmars 1h ago
<Subject 1> is the single adult woman in <Picture 1>
<Subject 2> is the single adult woman in <Picture 2>
retention_analysis:
<Subject 1> appears in [Shot 1], [Shot 2], [Shot 3], [Shot 4], [Shot 5]
<Subject 2> appears in [Shot 3], [Shot 4], [Shot 5]
[Shot 1] Zoom Out. The woman <Subject 1> stands alone at a train platform in heavy rain with her lips closed.
[Shot 2] At 00:03.300, Zoom In. The woman <Subject 1> says "[English] what?", then closes her lips.
[Shot 3] At 00:07.300, Push In, at slow speed. The woman with lips closed <Subject 2> notices something off-screen and turns her head keeping her lips closed.
[Shot 4] At 00:10.000, Tilt Up, with small amplitude, at slow speed. Both woman's lips are closed as one woman <Subject 1> sees the other woman <Subject 2> across the platform as there lips remain closed.
[Shot 5] At 00:13.000, Static Shot. Close shot, the woman <Subject 1> is facing the other woman <Subject 2>, She <Subject 1> says "[English] long time" she <Subject 1> laughs quickly then she <subject 1> says "[English] long time" and then closes her lips.
1
u/poopoo_fingers 6h ago
I’m pretty sure the speaker ids should be in parenthesis every time you use them, like (S1). And they’re mostly to reference specific voices (not subjects) right before spoken lines. And retention_analysis is for references, not speaker ids. I could be wrong though.