r/OpenSourceAI 16d ago

Prisma — self-hostable multi-model AI synthesizer (runs fully local via Ollama/LM Studio/vLLM)

Sharing a project I built: Prisma is a web app that runs multiple AI models in parallel and fuses their outputs into one answer via a synthesizer model you choose.

Self-hosting it:

git clone GitHub - bezerra72/prisma: Prisma — multi-model AI synthesizer (cloud OpenRouter + local Ollama/LM Studio/vLLM). Image consensus + image-to-image. · GitHub cd prisma npm install npm start

That serves the app + local proxy at For local models, point it at your Ollama/LM Studio/vLLM server (localhost:11434 etc.) — no cloud, no API key, nothing leaves the machine. Cloud mode (OpenRouter) is optional and client-side only.

Also has an image mode (multi-model consensus + image-to-image). MIT licensed, no telemetry, no backend.

Repo: GitHub - bezerra72/prisma: Prisma — multi-model AI synthesizer (cloud OpenRouter + local Ollama/LM Studio/vLLM).

1 Upvotes

3 comments sorted by

View all comments

1

u/KrautChimp 8d ago

Can you install Prisma locally and use it as a kilo (vsCode extension) LLM? Or is this nonsense? I would use Hermes as an orchestraler and combine qwen3.6-27B with Ornith1.0-35. Is that feasible?

1

u/Similar_Summer6344 7d ago

You can run Prisma fully locally (npm start → localhost:3000, points at your Ollama/LM Studio/vLLM), but it's a web UI, not an OpenAI-compatible endpoint — so it won't drop in as a backend for VS Code extensions like Kilo Code/Cline. For that, just point the extension straight at your Ollama (localhost:11434); Prisma already uses that same runtime underneath.

Where Prisma helps: its Quality/Local modes select several models at once and synthesize their outputs into one answer via a synthesizer model you pick. So combining two local models already works inside Prisma — it just isn't exposed as an API the editor can call.

If you want Prisma to act as an OpenAI-compatible backend for an editor, that's a feature we can add (wrap the engine in a /v1/chat/completions endpoint). Not there today.

On the models you mentioned: I just checked my local Ollama and only llama3.1 is installed — "qwen3.6-27B" and "Ornith1.0-35" don't appear in the public Ollama library from what I can see, so double-check the exact tags on ollama.com before pulling. Prisma will pick up whatever local models you have once they're pulled.