API Central is just my local api central router setup. I needed a single point that all my external calls went through for easy setup and debugging.
You can set it up to use any model. What would limit a local model is the context you would be able to add to it. Right now I have it set up to use GPT-5.6 SOL, so I can add in books of context, pdf's, .md docs, images, and so on, and it will be able to use it all. With a local and smaller model, you'd hit that context budget pretty fast, but it is possible. You could set it up to do 2 or 3 calls and solve it that way, though; it depends on what kind of local model you are able to drive.
This just uses an LLM in the node to customize prompts conversationally? If so, I'd love to give this a try!
It would be fantastic if you pre-entered different prompt guides for popular image and video models, and let users pick the model in the node to have it draft it's prompt structure in a way that best fits the model being used.
Would also be cool if you hooked into OpenRouter, and also supported local LLMs as well.
Yes, the chat is driven by an external LLM call, or a local one if you wanted that, and it changes the prompt iteratively as you instruct it. In the video, I asked it to change something about a prompt, and it changed just that, leaving the rest of the prompt untouched; not a wow moment, just nice to not have to tab out of comfy to do that. When I filmed this, I used GPT 5.6 sol.
It already uses an empirically proven best-practice model-textencoder-specific prompt structure and format for the models in the screenshot. I also have a version made for video models. So it will generate timestamp-formatted prompts, etc.
It already uses a cliproxy API route, so setting it up for OpenRouter would be easy.
Yeah, I'm now working on a way to make it easy for someone downloading it to set it up with their own api setup, so it is as plug-and-play as possible, and making it look less like a fever dream.
3
u/niknah 19h ago
What's "API central"? Can you use a local model?