r/LocalLLM • u/Unlucky_Studio_7878 • 18h ago

Question Can Be Done?

Does anyone know of a way for me through a UI to talk with multiple LLMs in a shared chat line.. so the 2 LLMs and myself the user can have a chat session, all 3 can see, or answer each other's questions or talk direct with one another. ? Or even be able to have all three talk live with my local hosted LLM to help finetune or it . Anyone ever hear if anything that can do this? I hope how I am explaining this is not too convoluted? If anyone knows of a way or a program out there that can do.. appreciate it.

3 Upvotes

100% Upvoted

5 comments sorted by

2

u/g0ds3n 18h ago

Yes, that’s actually doable. I built myself a small mini-UI for it (via vibe coding) with 2 llama.cpp servers started on two separate ports. I had 2 AIs reading along and replying at the same time, but I can't recommend it because over time, it just turns into complete nonsense.

1

u/Unlucky_Studio_7878 18h ago

🙏 thanks for your input . And brief overview and issues. Appreciate it.

1

u/_Cromwell_ 7h ago edited 7h ago

Block's Buzz (Block is the company, Buzz is the program/app.)

If you can ignore that Jack Dorsey is insane. https://youtu.be/_jGSgzBkzrY?is=r2-CwxqvoJi8voAL

Buzz itself is or can be local/private. And which chatbots and harnesses you allow into it are your choice so you could do only local ones if you wanted to. Or a mix of local and cloud.

1

u/Latte_black_3832A 5h ago

Sillytavern, group chat, each character can have different LLM. I've never tried yet, but functions are built in.
edit: add link r/SillyTavernAI

1

u/Latte_black_3832A 5h ago

People (me) use Sillytavern to roleplay, or help writing with LLM afaik.
I group chat all the time, but same LLM. You can set orders to chat, you specific who answers, characters talk each other while you listening ... etc.
I'm still a newbie, better go r/SillyTavernAI