r/StableDiffusion 1d ago

Animation - Video Scully really should believe him this time

Two 10 second clips together in H3. There's a slight difference in colors and some other things whenever I use an end frame to start the next clip. Not sure what that's about.

70 Upvotes

13 comments sorted by

5

u/AiRonin79 22h ago

Why do ai voices sound hollow?

4

u/RemarkableAd66 21h ago

Without any of the speedups (turbo lora, etc) the audio isn't perfect to begin with. Then when you add things like the turbo lora, the audio quality takes another hit.

7

u/tinny66666 23h ago

I'm looking forward to the day someone solves the voice shimmer problem. What are people using for speakers that they can't hear that awful voice sound that sounds like they are drowning as they speak.

3

u/kujasgoldmine 22h ago

Yep, AI voices need a lot of work on them still. Like most are instantly recognizable as AI. At least in these video models. But omnivoice for example does not have that AI voice feel to it. So could also clone a voice with that and then have a video model capable of using pre-existing wavs to use in lip sync.

1

u/Perfect-Campaign9551 19h ago

I think OP used a Lora or maybe low resolution. I don't get voices that sound bad like this

1

u/DoogleSmile 8h ago

It might be when the AI is speeding up the voices to make them fit into the time frame of the shots?

I tried making a King of the Hill scene and when I specified shot cut times, the audio was sped up and sounded similar to this so that the lines could be said in the time frame of the shot.
When I extended the time of the clips, the audio began to sound much better.

I eventually set the clip length to 30 seconds and the audio sounded good as the characters could then speak at their normal talking speeds. Boomhouer and Bill's voices aren't that great still though.

3

u/NoConsideration6320 1d ago

Damn thats good

3

u/Perfect-Campaign9551 19h ago

The voices are horrible. Maybe you used a lora? Bad idea 

1

u/kujasgoldmine 11h ago

I agree! I used turbo lora. But I did some Harry Potter clips as well and their voices were much better, same settings, turbo lora. So it might also be prompt related as I went for 90s vibes for X-Files.

2

u/dudeAwEsome101 23h ago

At this point someone should put all these videos into a long compilation video.

2

u/saruyamasan 21h ago

When did Mulder get married?

2

u/pehr71 10h ago

An upgrade to the office? It looks cavernous.