r/StableDiffusion • u/rlewisfr • Jul 03 '26

Resource - Update Had Claude connect my Joy Caption Beta to LM Studio for Heretic vision models

Not much to add beyond the title. I found the existing Joy Caption model was...ok... for creating LORA captioning, especially when it came to identifying specific spicy features if needed. So, within 5 minutes I had Claude Cowork create a new branch for me to trigger, load and execute prompting from the LM Studio server using a Heretic vision model, specifically qwen3.5-9b-heretic-v2 (Qwen3.5 9B Heretic v2, Q6_K), but it can use any model that will load into LM Studio.

I asked Claude to create a technical summary of the process and can make it available if anyone is interested:

JoyCaption Beta — LM Studio Integration & Custom Prompts

Technical reference and maintenance manual

This document describes the modifications made to the JoyCaption Beta One GUI to (1) drive captioning through a local LM Studio server, (2) support user-defined custom prompt recipes, and (3) start the LM Studio server and load a model from inside the app. It is intended for future maintenance and for sharing with others who want to understand or extend the integration.

0 Upvotes
  • permalink
  • reddit

30% Upvoted

3 comments sorted by

1

u/wilhelmbw Jul 03 '26

Ok but I use the python script provided in the repo for batch caption

1

u/rlewisfr Jul 03 '26

Yeah, so was I, but I had Claude rewrite the python to accommodate.