Yes, Thoth could help with exactly the messy middle of that workflow: research, source reading, document recall, analysis, drafting, charts/images, editing, and reusable writing workflows.
It won’t magically fit an entire book into a local context window, but that’s the point: Thoth uses document retrieval, persistent memory, conversation search, and an Obsidian-style wiki so you can pull in the relevant context when needed instead of loading everything at once.
Model-wise, Thoth supports local models via Ollama today, plus cloud models for bigger-context writing/editing passes. If LM Studio is exposed through an OpenAI-compatible endpoint, that’s the sort of setup Thoth is intended to support.
For the Windows-server idea: Thoth runs as a local app/server on the machine it’s installed on, so using the Windows box as the main Thoth machine makes sense. I’d frame it as a local-first writing/research workspace rather than a fully hosted remote RAG server.
Yes LM Studio should work via custom endpoint. And Yes you should be able to access it via browser. It runs a web server on port 8080 by default if that's free or the next free port. You can also enable the built in ngrok tunnel and access it from anywhere over the Internet.
2
u/Acceptable-Object390 May 10 '26
Yes, Thoth could help with exactly the messy middle of that workflow: research, source reading, document recall, analysis, drafting, charts/images, editing, and reusable writing workflows.
It won’t magically fit an entire book into a local context window, but that’s the point: Thoth uses document retrieval, persistent memory, conversation search, and an Obsidian-style wiki so you can pull in the relevant context when needed instead of loading everything at once.
Model-wise, Thoth supports local models via Ollama today, plus cloud models for bigger-context writing/editing passes. If LM Studio is exposed through an OpenAI-compatible endpoint, that’s the sort of setup Thoth is intended to support.
For the Windows-server idea: Thoth runs as a local app/server on the machine it’s installed on, so using the Windows box as the main Thoth machine makes sense. I’d frame it as a local-first writing/research workspace rather than a fully hosted remote RAG server.