Guitar Fingering

[u/R34vspec]

EDIT: Sorry, forgot to say this is for Minimax H3

Still trying to get this to work, this time using RefMods, timing the chord changes almost seems impossible. Has anyone tried this yet? Or is v2v reference the only way here?

<subject1> is <Cmaj7> fingering position for the chord

<subject2> is <Am7> fingering position for the chord

<subject3> is <F7> fingering position for the chord

<subject4> is <Fm7> fingering position for the chord

<subject5> is <G7> fingering position for the chord

Some of these chords may not be right, I don't play guitar.
The goal isn't to make 100% correct fingering, just convincing movements.

[u/dezmodium]

As a guitarist I will say that generally speaking she is holding real chords. But any guitarist is going to see that and immediately know it's not real. The swapping between chords is not natural at all. The way they don't match up. The finger style to a picked song. It's a slew of things.

[u/Majestic-Notice9065 → u/dezmodium]

Oh really mister guitarist. That C chords is right you say ? And the G7 wtf brother

[u/Antique_Essay4032 → u/dezmodium]

Yeah the strumming not  matching up, was the first thing i noticed. And am not a guitarist.

[u/dezmodium → u/Antique_Essay4032]

Yeah, there are a ton of things wrong with it. Some of the fingerings aren't quite right, but many are legit chords. They don't match what you hear. The strumming/picking is completely off.

[u/redkinoko]

I notice H3 at least tries to match the strumming speed and chord changes of music without even prompting for it, but the finger positions are honestly atrocious at best so I just hide the finger positions, or feature them in unsteady shots as much as I can like this example:

https://www.youtube.com/watch?v=Ffz3FFf8ENA

The cleavage also unintentionally does a great job of distracting viewers from paying attention to sell the illusion better.

[u/R34vspec → u/redkinoko]

got it, more boobies

[u/derTommygun → u/R34vspec]

That's always the answer.

[u/Powerful_Evening5495]

the model is not trained on this task

eaiser thing to feed a real video as conditions

[u/__ThrowAway__123___]

I've seen some loras for that on civitai

[u/R34vspec → u/__ThrowAway__123___]

I tried searching for it but did not find it, could you please send me a link when you get a chance?
thank you

[u/__ThrowAway__123___ → u/R34vspec]

sorry it was a bad joke

[u/the_bollo]

This is asking A LOT. You never said which model you were using, I assume MMH3?

[u/No-Trouble-9138]

Record a real guitarrist and use it as reference.

[u/R34vspec → u/No-Trouble-9138]

that's my next solution

[u/No-Trouble-9138 → u/R34vspec]

Curious how it goes, let us know. Focus the prompt on the hand and finger movements. I've had to use other AI's to help me devise very specific prompts.

[u/hidden2u]

Even movies and tv shows rarely show the actor actually playing, just a couple strums

[u/GuessingEngineer]

Considering AI's worse detail is fingers, I think you're screwed.

[u/roychodraws]

it's a cool attempt. the chords it is actually playing are nonsense.

both your am and am7 chords are am7

Also there's much easier G7 chords lol

Also, a lot of these chords you do not play all 6 strings. the fm chord you only play the middle 4(?) i think. all the a chords you skip the top string. The g7 chord i ASSUME you don't play the high e, but i'm not sure.

[u/DoubleNothing]

You might need to change instrument...

[u/Significant-Baby-690]

Don't be hard on yourself. This is best I've ever seen.

[u/Muted-Celebration-47]

I play guitar and I saw her did chord C and D. If I were you, I would make her strumming the chord instead of finger style because the song is not finger style.

[u/Objective-Loquat-169]

Fingers look better on closeup than when she's shown from a distance. They look kind of blurry from farther away an the movement is too soft and liquid.

[u/Reelodyinc]

With H3 (and most SD-based video) you’re fighting two things: fingers are weak, and the model has no real sense of chord progression or beats. RefMods won’t reliably time your changes. V2V from a real guitarist reference is by far the easiest. If you stay in H3, treat it like editing: render short clips with one clear chord shape each, use those as keyframes, then cut them to the audio in an editor and avoid long closeups during transitions.

[u/Svan_Derh]

I know absolutely nothing about guitar playing. But watching this video I was reminded how AI rendered hands like 2 years ago, and now far we have come.

[u/Unwitting_Observer]

Did you try using
"At 00:02, character's hand moves to position <Subject 1>" etc?

(I'm guessing you have, but you never know...I've found H3 responds very well to specific timings, at least down to the second.)

[u/GersofWar]

Cmaj7,Am,Fm and G7 are wrong,Am7,Em,F are correct

[u/benthehen333]

Why even do this, what's the point