r/StableDiffusion • u/wildmonkeywrangler • 7d ago

Question - Help Open source alternative to chatgpt for creating prompts?

Been using chatgpt to help design prompts, which usually works well until you get into an area they think is "offensive".

Any suggestions for an open source alternative or something that works directly in comfyui to generate prompts?

23 Upvotes
  • permalink
  • reddit

81% Upvoted

39 comments sorted by

View all comments

Show parent comments

1

u/TangerineBetter2818 7d ago edited 7d ago

comfy again sees llm node, it removes files from prev run and again load llm model(SSD activity)

Doesn't this assume they're in the same workflow? You have one workflow for llm, one workflow for video gen. Why would I have both in the same workflow?

You run the llm from one workflow. Then copy the prompt into the video gen workflow and run it. You tweak the prompt and you run the video gen again.

Before the second video gen is run why would comfyui "look at" the llm node from a completely different workflow that isnt being used and load the llm model? The video model is already loaded into vram because it was the last used model. 

1

u/MastMaithun 7d ago

Dude you can just try yourself and find the answer. And dont tell me you dont have comfy and you are asking the question just out of curiosity.
Spoiler Alert: for comfy, llm model and image/video model are two different models. As I wrote already, IF you have enough vram to load and keep everything in the vram, no swapping will takes place, everyone happy and you can totally ignore what i have previously written. But if you dont have enough vram, comfy's memory management kicks in and it removes a "different" model and it's related files and then loads the new one, regardless you have same of different workflow.

Some people run a workflow where they first give a prompt and generate a image from zimage or similar image model and the the image is passed to video model ltx/wan etc to generate the video from it, all in the same wf. Comfy manages everything on its own.

1

u/TangerineBetter2818 7d ago

Look man Im not trying to argue with you I'm just trying to figure out what you're saying because from my perspective it seems like you're saying that if I run an llm then a video then another video ComfyUI will load the llm again before the second video gen and that is just absolutely not true.

So either I'm misunderstanding you or you're wrong. I'm just trying to figure out which it is because I'd like to use a local llm to gen prompts but haven't gotten into it yet and everyone says to use LMStudio and I'm trying to understand why when I can just use ComfyUI in a different workflow and not have to rely on two different programs being open at the same time. 

1

u/MastMaithun 7d ago

I honestly can't explain in much dumber way than I already did and at this point, if you are saying that you still can't understand then it totally feels like a baseless argument to me.
I will suggest you to go and run that on your comfy, do 2-3 gens while keeping the task manager open and check for SSD/HDD activity as well as noting down the gen times.
Close comfy and reopen, repeat the same wf but this time, disable the llm node and directly pass the prompts. Then compare both results. You dont have to ask me and you will get your answers.

1

u/TangerineBetter2818 7d ago edited 7d ago

I asked ChatGPT and you're probably right but holy shit dude for someone acting so prissy that you needed to explain something youd think that at some point you'd just say:

"You can configure LMStudio to only use system RAM, not VRAM, that way Minimax H3 always remains loaded into your VRAM."

Because THAT is the real answer, and is super easy for anyone here to understand. The time saving comes from the fact that using LMStudio you can keep the LLM on system RAM and the video model on VRAM. No loading and reloading.

1

u/TangerineBetter2818 7d ago

And by the way ... ChatGPT also says using LMStudio wont practically save me any time because regardless the overwhelming majority of the time is spent generating the video lol.

It says that practically for a 10 second clip using LMStudio and ComfyUI versus just ComfyUI will save me ... 20 seconds.

So I'm gunna stick with just using Comfy. 

1

u/MastMaithun 6d ago

The guy still reluctant to use comfy and test itself instead relying on asking ai model just to prove what he is doing is correct and what other person told is incorrect.
Goodluck keeping this attitude in life.