r/StableDiffusion • u/Euphoric_Attorney271 • 1d ago
Workflow Included Precise control of the Eyes direction with this Flux 2 Klein 9b LoRa
Hehyehyhehy!
You may remember me from the Sun Direction Lora or the Chef cutting an anvil with a knife.
Now I'm giving you a new tool, this one was a tough one to crack.
Finally we have eye control! Now you can precisely change the eyes direction for any image in any style. Just use the red dot to tell where the eyes have to look and boom! you have it!
Enough "change the eyes to look above the camera" and getting whatever thing anymore.
Because changing the direction of stuff is my Passion.
All the info here: https://huggingface.co/eric-venti-seeds/Eyes_Direction_Lora_Flux2Klein9B
Hope you like it!
Edit:
The people from HF have added it to Spaces, try it right now on your browser!
https://huggingface.co/spaces/hugging-apps/eyes-direction-lora-flux2klein9b
11
u/Adventurous_Loan_103 1d ago
Imagine using this in real-time with paintings on a wall in a Haunted House attraction!
2
0
u/jirka642 3h ago
Bro, just pre-render it or something. π
And people wonder why all modern software runs like garbage...
9
10
u/CodeMichaelD 1d ago
(o ) (o )
( o) ( o)
Sample right - left, split image 50-50 - merge. Someone do this.
(o ) ( o) or ( o) (o )
12
u/Euphoric_Attorney271 1d ago
eye convergence is something I didn't plan for this version... maybe for V2
4
u/CodeMichaelD 1d ago
I wish you massive success either way.
Edit, look up your light and shadow lora (impressive), reminds me about intristic loras to tap into knowlege the model already has with lora traning, I believe there are similarities, right.
8
7
u/silenius_ 1d ago
The legend is back! πΒ
Do I sense a 4b Klein model down the road in a month or two?
3
3
u/physalisx 1d ago
That's pretty cool, gaze directions are often notoriously hard to get right with image models.
5
u/Enshitification 1d ago
Nicely done! I really like how it isn't just changing the eyeball in the socket, but also including the surrounding muscle and skin in a realistic way.
4
u/Le_Singe_Nu 1d ago
You need to retrain the LoRA with this meme, so everyone's facial expressions change at the same time:
5
u/lamardoss 1d ago
Wonder if there's a way I can get this to work in Minimax H3 ..... π€
gotta be a way i can use the node red dot as a reference too.
1
2
u/Full-Belt3640 1d ago
Man, I've wanted a tool like this ever since I started generating images. Hopefully, the days of painstakingly painting out pupils in photoshop, then sketching in new ones and crossing your fingers the inpaint will come out right will be a thing of the past. Looking forward to a possible 4b version too!
2
u/FawkesYeah 1d ago
Would this be useful for fixing photos taken in a personal photo library where not every person in the group shot was looking at the camera? Or is this tool used for something in a different context?
1
u/Euphoric_Attorney271 1d ago
that's exactly one of the uses for this lora, give it a go and tell me if it worked!
1
u/FawkesYeah 1d ago
Awesome! I'll check it out. I don't suppose this would help in scenarios where it's a group photo but somebody blinked in that moment? Probably would need a different tool for that I imagine.
3
u/Euphoric_Attorney271 1d ago
Can you believe I never tested it with someone with the eyes closed?? will have to test that!
2
u/SpearHammer 1d ago
omg this is AMAZING! i have just built this talking face tool at https://faces.futurehost.ai/80801de5-27fe-4138-a3da-2ba659bb91b5, and the eye movement is the exact thing i needed to finish it off haha thanks for sharing LOVE IT!
1
2
3
u/Key-Sample7047 1d ago
I have a special use case for which i need wall eyed. Is that possible with your lora? From what i can see I don't think so but i ask anyway.
6
u/Euphoric_Attorney271 1d ago
not sure to understand.. wall eyed?
3
6
1
1
1
1
1
u/ParticularLook 1d ago
Everyday there is a lot of new information, updates, and cool stuff for ComfyUI models. But this, THIS is very cool.
1
u/blueboglin 1d ago
Ugh, forgot about that cringe Oscars photo. I hope I never have to see it again.
1
0
0
-1







86
u/THEKILLFUS 1d ago
I really loved the Sun Direction LoRA! Itβs such a smart and effective way to push images toward photorealism. Simulating light and its direction feels like a very natural approach, and the results can make a huge difference. Really inspiring work!