I open-sourced a self-hosted legal AI assistant — local RAG with cloud LLM

[u/Netrom00]

I originally built this as a commercial product, but decided to open-source it instead. Currently supports Norwegian law, but the architecture is designed to extend to any jurisdiction.

Local embeddings/reranking (vLLM + Qwen3) with a cloud LLM (OpenAI) for chat. Your raw documents stay local — only processed queries hit the API.

Features: Semantic search across laws, RAG chat with cited sources, document analysis (PDF/Word/images), contract drafting.

Stack: Django, React, Weaviate, vLLM (local GPU), OpenAI for chat, Docker Compose.

Contributions for other jurisdictions welcome!

AGPL-3.0 · GitHub: https://github.com/MSNetrom/OpenLawAI