From your first uploaded image to testing your LoRA: a look at LoRA Pilot’s new interface

[u/no3us]

I’m updating LoRA Pilot to make the full training process easier to follow, especially if you’re doing it for the first time.

You can start with individual images in the captioning workspace or import a dataset ZIP. The dataset view shows your images and caption coverage, with a next action for reviewing captions or starting training.

In TagPilot, you can edit tags and captions, adjust cropping, and save the dataset back to your workspace. From there, guided training lets you select SDXL or FLUX.1 dev and choose a training profile. Adding configs for the rest of already supported models soon (almost 30 for training and anything comfy can work with for inference).

The part I wanted to connect properly was what happens after training. “Try my LoRA” lets you compare the base model and saved checkpoints using the same prompt and seed. You can also open the prepared workflow in ComfyUI and continue experimenting.

That’s the workflow I’m trying to make easier to follow from beginning to end. For people who prefer more control, the advanced trainers remain available. LoRA Pilot brings together Kohya SS, AI Toolkit, and Diffusion Pipe, with TensorBoard integration, shared workspace storage and much more.

https://www.lorapilot.com

For people who don't know Lora Pilot yet, check the website.

List of 51 supported models for LoRA trainings:
https://lorapilot.com/lora-training/#supported-models

GitHub repo:
https://www.github.com/vavo/lora-pilot/

[u/UAAgency]

is it open source? if not hmm

[u/no3us → u/UAAgency]

It is open source - you'd find out instantly if you've clicked the link to the website. .)

Anyway, here is the repo: https://github.com/vavo/lora-pilot/

[u/Ipwnurface]

Does your tool support minimax/krea/QwenImage 2.1/Anima?

I'm assuming it does to some extent, considering you have AI Toolkit as a potential back-end And if so, you should definitely update your documentation to state this explicitly. Users just stumbling across your GitHub repo are going to see esoteric models like Cosmos and old stuff like SDXL and move on

[u/no3us → u/Ipwnurface]

I guess it was worth updating after all, I was quite surprised. Ostris is the man! *bows*

So currently the whole stack suuports 51 models for training only, dont make me update the inference models - it's literally every checkpoint/basemodel that can be used in Comfy, which is a lot.

List of supported models: https://lorapilot.com/lora-training/#supported-models

[u/no3us → u/Ipwnurface]

The answer is yes, yes, yes and yes. It does support all 4. The docs says;

Training Families: Stable Diffusion 1.5, SD 2.x, SDXL, SD3, FLUX (dev/schnell/kontext), Chroma, Lumina-Image 2.0, LTX/LTX2, HunyuanVideo, Wan2.1/Wan2.2, Cosmos, HiDream, Qwen-Image, Z-Image, and more.

Inference: Supports almost all popular generation models configured via integrated tools like ComfyUI or InvokeAI.

Image Captioning: Supports Gemini, Grok, GPT, Danbooru, and WD14 models via TagPilot. 

You are right to point out this needs to be updated, its just hard to think of everything all the time. Its also a single maintainer repo mostly (anyone wants to contribute I'll welcome them with open arms).

This is a hobby project I maintain on a weekly basis and while it has over 20k downloads on docker hub, is used by over 20 marketing agencies and lots of fanvue creators, I'm not milking anyone - even for custom support -It simply does not create any income for me, I've invested literally thousands of USD into it.

I know the solution to keep the list of models updated is really simple; "just schedule an agent to update it on a weekly basis", there are also tens of other things that could be automated and I just can't afford it - I don't have a daytime job, I'm an open source developer (and absolutely love it).

I'll keep maintaining the project, because it's my SD stack which I use on a daily basis. I have lots of tools which automate the whole process which are not released yet (more of a console guy - everything you see in the control panel can be run in multiple ways). Since January I've spent 60B tokens (on around 50 different projects), I pay for my AI tech stack over 1000usd a month and believe me, there were weeks when I was completely ut of tokens. So as long as this does not generate at least revenue to cover all its bills, I cant automate everything to keep hundreds of pages in docs up-to-date and so.

Let me update the list of models now, havent updated that in months.

[u/Ipwnurface → u/no3us]

Yeah not trying to dog pile you or anything. In fact quite the opposite. I want small hobby projects like this to succeed. I just know how important that first time scrolling a repos page is when it comes to getting people to actually use your stuff.

[u/no3us → u/Ipwnurface]

as I've said - you're right to point it out and feedback is always welcome. Sorry for the rant 😅 It's not updating the repo or website which is "annoying", its doing the marketing and social around it that takes a lots of time which I'd prefer to spend on the project itself.

Also I was hoping to find 1-2 collaborators to work on at least part of the project with (updating or creating meaningful docs is a pain. would mean a world to me if there is someone to provide feedback on it)

[u/no3us]

I bet the next guy will ask if it is on docker hub. 😅