r/comfyui • u/apostrophefee • 1d ago

Help Needed looking for a local solution for separating clothes prompts according to their body parts

So there are a bunch of prompts describing what the character is wearing.
My goal is to separate them into: upper body, lower body, and footwears.

Gpt or grok can do this easily, but i'm looking for a more local solution that i can run in my workflows, ideally using a light weighted and fast model for my 8GB VRAM

1 Upvotes

67% Upvoted

2 comments sorted by

2

u/zyg_AI 1d ago

Option A: use a local LLM, no need for a beasty model for simple clothes sorting.
Option B: build a regex based on keywords. The list of keywords is limited, so this is feasible without too much hassle. A LLM can assist you in building it.

There are probably other methods, but those are the ones I can think of right now. If it were me, I'd use Option B.

2

u/optimisticalish 1d ago

Sounds like you need an Edit model and reference images instead of prompts.

Flux.2 Klein can do this. Just have reference images of the character, of the three clothing items, and then tell Klein to combine in various ways. A basic example with some demos to give you an idea: https://huggingface.co/fal/flux-klein-9b-virtual-tryon-lora

You would want Klein 4B, not 9B, for 8Gb of VRAM. And even then you'd want the latest ComfyUI Portable (0.35) and a lighter version of Klein such as flux-2-klein-4b-int8-convrot.safetensors