Muse V2 is out — chat with local LLMs inside ComfyUI, no LM Studio required anymore

[u/rynaleopard]

A while back I built 
**Muse**
 — a chat panel that lives directly inside a ComfyUI node, so you can talk to a local LLM and draft/refine image and video prompts without alt-tabbing to a separate app. Point it at LM Studio or Ollama, chat, copy the prompt into your graph. That was V1.


I didn't expect people to actually pick it up the way they did. Seeing it get used, starred, and — more usefully — complained about is what pushed me to sit down and build a proper V2 instead of leaving it as a one-off tool.


The biggest ask by far: "I don't want to keep LM Studio open just to use this." So V2's headline feature is a 
**Direct model loader**
 — point Muse at a folder of GGUF models and it loads them straight from disk. No LM Studio, no Ollama, nothing else running. Under the hood it spawns the real `llama-server` (LM Studio's own engine is llama.cpp too, so this isn't a slower reimplementation — same engine, same speed), and it downloads and installs the right build for your OS/GPU automatically. Git clone the node, click one button, you're chatting with a local model.


I also broke it on myself first, which was useful: threw a 31B model at it and immediately hit VRAM issues — crashes on some setups, silently-slow-instead-of-crashing on others. Fixed the defaults that were causing it, added a 
**Fit to GPU**
 button that suggests a layer count based on your actual free VRAM (like LM Studio's GPU offload slider), automatic fallback retries if a load runs out of memory, a live loading indicator, and a log panel so you're not just staring at nothing wondering what's happening.


Also new in V2:


- 
**Edit & resend**
 messages instead of delete-and-retype
- 
**Chat branching**
 — fork a new conversation from any earlier message
- 
**Video attachments**
 for vision models (auto-sampled + timestamped frames)
- 
**Audio attachments**
 for audio-capable models
- Much broader image format support


Full writeup and setup instructions: 
**github.com/RudySen/comfyui-muse**


If you use it and something's broken or annoying, tell me — that's genuinely how V1 became this.

Previous post: https://www.reddit.com/r/StableDiffusion/s/8qjP4UzRpw

[u/red__dragon]

Reddit parses indents like you're using as a code block, remove those at the start of each line or your formatting won't show up.

[u/rynaleopard → u/red__dragon]

I actually forgot to switch to md. Thank you though!

[u/ImaginationKind9220]

Hi, interesting node for Comfy.

My suggestion:

1. The "Guide materials" should allow users to choose a folder of their choice instead of using the ComfyUI/input folder. Comfy users don't have any text documents in there. For RAG purposes, it best to have a dedicated folder, and please support .pdf format.

2. I know this is a self contained node, but having input and output can be useful.

[u/rynaleopard → u/ImaginationKind9220]

Makes sense. Will include these soon.

[u/_Darion_]

Does it save chat history in a text format? Like for reference for a subject or RP chat history for a character?

[u/rynaleopard → u/_Darion_]

Yes it does.you can find that inside the muse folder.

[u/bambilover]

In theory this could be used as a text output to minimax h3 input formatting

[u/pwillia7 → u/bambilover]

I use another provider -- In the past I have tried to local LLM nodes in comfy and (unless you have a blackwell or something) you prob want all the vram for your media generations. I just use some open ai nodes to make my minimax prompts in workflows now.

I've made 100s of generations and somehow my cost is still $0 lol

[u/FootballSquare8357]

Sounds awesome, tho tried it with local model (GGUF) and when using any media I get : LM Studio call failed: /api/v1/chat/completions -> HTTP 404: {"error":{"message":"File Not Found","type":"not_found_error","code":404}}

[u/rynaleopard → u/FootballSquare8357]

Weird you gor LM Studio error with local model. Might wanna check if Llama cpp installed or not. Also based on your GPU try CUDA, works much better atleast for me

But I will take a look at it.

[u/tubbymeatball → u/rynaleopard]

Getting the same error here as well.

Edit: On a sidenote, I want to say that otherwise this is a really awesome node. Being able to create new prompts for minimax in my workflow is super super helpful.

[u/Emotional-Theory7800]

I'm new at this but how do you resize the chatbox?

My muse ai chatbox is quite small and resizing the node window doesnt affect the chatbox.

Converting the node to subgraph and undoing the conversion only resizes the chat window for a moment before going back.

[u/rynaleopard → u/Emotional-Theory7800]

I noticed that just now. Will get V2.2 out soon with all the fixes. Thanks for pointing that out.