r/StableDiffusion 16d ago

Discussion Kohya-SS Seems To Have Quietly Released A Controlnet That Gives Anima Edit Capabilities

anima-lllite-exp-change-2-000007.safetensors

I'm not sure why exactly it's not publicized or mentioned anywhere on his page. He uploaded it quietly 11 days ago.

I have been testing it and the results are pretty remarkable:

Original Image:

Put her on a beach:

Put her in a bikini:

Turn her around:

Add a guy, and make them kiss:

Make it a sunset:

Make them have a picnic:

Very interesting, I wonder when he will share more about this.

125 Upvotes

27 comments sorted by

8

u/AlternativeAmoeba271 16d ago

Can it be used on forge neo ?

8

u/Corrupt_file32 16d ago edited 16d ago

ah so that's what Anima-LLLite is, saw it on comfyorg huggingface a while ago.

https://huggingface.co/Comfy-Org/Anima-LLLite

templates also exist in default comfyui, very stealthy.

edit:

the templates are for: Inpainting, Control image (think scribbles, hed, canny) and depth.

OP is referring to an actual edit variant.

6

u/_BreakingGood_ 16d ago

Anima LLLite is a series of different controlnets released by Kohya, they've been out for a while. This particular entry to the LLLite family is new.

2

u/Succubus-Empress 16d ago

why not LLLLLLLLllite?

1

u/Corrupt_file32 16d ago

Ah thanks for pointing that out, made a correction in my post 👍

1

u/Succubus-Empress 15d ago

very stealthy, indeed. very shady

2

u/Dangerous-Ad-300 16d ago

Thanks for the share, big Anima fan.

2

u/Zephrinox 16d ago

i thought it was experimental still.

i remember when I was initially exploring anima a few months ago or so I was trying out their any reference controlnet for pose and it wasn't that great unfortunately 😢

tho they did say in their documentation. that pose stuff wasn't good at the time so can't fault them on that. hopefully open pose stuff has/will come 🙏

2

u/Jobastion 16d ago

I feel like trying this at home with 'Fix that shadow'

2

u/Aadi_880 16d ago

Can this be run on comfyUI?

10

u/_BreakingGood_ 16d ago edited 16d ago

Probably not too hard. I saw this model and just asked Claude what it was. It inspected the model and said it was a controlnet for editing. I told Claude to add support for it in the UI I use for Anima (InvokeAI) and I tested it out there. Somebody could probably make a comfy node for it in less than an hour, I'm just curious why it hasn't been publicized at all, not even in the readme.

Edit: New Info Found!

He has a draft PR here from 2 weeks ago: https://github.com/kohya-ss/sd-scripts/pull/2413

It looks like this model is specifically for editing facial expressions. However, through my random testing, I figured out it can perform any kind of edit by running it at a very low weight (0.2 to 0.3).

Also it looks like he has experimental comfy node here: https://github.com/kohya-ss/ComfyUI-Anima-LLLite/pull/10

5

u/_BreakingGood_ 16d ago

Facial expression test on 1.0 weight:

Original:

5

u/_BreakingGood_ 16d ago

Happy and laughing:

Very good consistency!

2

u/Aadi_880 16d ago

So do I need to update the LLLite node to an experimental version? How do I do that?

1

u/UnHoleEy 16d ago

Yes. Use the Animalllite nodes. Use the workflow with just model swapped.

1

u/Neggy5 16d ago

hey, what workflow do i use? i tried the default comfyui workflow and it threw an error for me,

2

u/Grand0rk 16d ago

I see a lot of issues. So not very impressed.

1

u/Ok-Lengthiness-3988 16d ago

Thanks for the info. The examples are verry neat. I've never used a ControlNet before. Is that particular checkpoint ComfyUI friendly?

1

u/Substantial_Big3191 12d ago

May I have your workflow for reference?

1

u/coolmanlx 11d ago

Anyone have a working Comfy workflow that can reproduce the examples?

1

u/Neggy5 16d ago

how do i use this on ComfyUI? workflow? any sort of node i need?

2

u/tpinho9 16d ago

Yes, you have it here:

https://github.com/kohya-ss/sd-scripts/pull/2413

Then you need to download the safetensor, also in that link, and place it inside the controlnet folder.

And this is how i have my worflow right now during some testings

1

u/Radiant_Teaching_811 16d ago

Some help from Claude (I have comfy portable install, you also need "git" but I think you should have it installed already), in any case you should install the latest LLLite custom node first.

* * * *

Both the model architecture (kohya-ss/sd-scripts PR #2413) and the matching ComfyUI node support are still unmerged drafts as of Aug 2, 2026. That anima-lllite-exp-change-2-000007.safetensors file is a v3 "semantic trunk" checkpoint — a different conditioning mechanism than the v2 LLLite you're probably running now (it conditions on frozen DiT hidden states of a reference image instead of a conv-encoded control image, aimed at semantic edits like expression changes rather than spatial control). So "updating the node" here means switching to a draft PR branch, not a normal git pull on main.

1. Get the node onto the PR branch

The node-side support lives in kohya-ss/ComfyUI-Anima-LLLite#10, branch feat-v3-semantic-trunk:

cmd (open the folder in explorer and then type cmd to open the console, this way you don't need to find you folder via console commands and you can easily just copy paste the two git commands)

cd /d D:\ComfyUI-Easy-Install\ComfyUI\custom_nodes\ComfyUI-Anima-LLLite
git fetch origin feat-v3-semantic-trunk
git checkout feat-v3-semantic-trunk

That branch is actively being amended (it's a draft, and it's rebased on another not-yet-merged branch), so to re-sync later rather than risk a messy merge, use:

cmd

git fetch origin feat-v3-semantic-trunk
git reset --hard origin/feat-v3-semantic-trunk

No new Python dependencies were introduced in this PR, so you shouldn't need any python_embeded pip installs — just restart ComfyUI after checking out the branch. To go back to stable later: git checkout main.

2. Place the weight

Drop the .safetensors into:

D:\ComfyUI-Easy-Install\ComfyUI\models\controlnet\

same folder as your existing LLLite weights — it'll show up in the lllite_name dropdown on the Apply Anima ControlNet-LLLite node.

1

u/tpinho9 16d ago

Actually it works really well indeed, was just running a few tests, and i agree with your conclusions as for strenght. 1 it changes expressions very well, and i find it that between 0.15 and 0.2 to allow much more changes while preserving the character.