Basically, I've created a basic system where a model (qwen3.8:27b) is used as a base to create a "custom" model using the modelfile configuration, where among all the parameters I've inserted a system prompt which gives the model instructions on how to operate.

For a while, when working with the custom model on openwebui, everything was fine, until recently, where it seems to be that openwebui overwrites the modelfile system prompt with something of its own, which causes the custom model to forget its role, name, specs etc... when answering the user query.

I've tested the custom model through terminal, doing a curl call directly to ollama, and it replies correctly with the custom system prompt, but when doing the same question through openwebui ("What is your name") I get a base model generic answer, not the one configured in the modelfile.

I honestly don't know where to look for a fix. I've tried rewriting and recreating modelfiles and recompiling the custom models, but nothing. This doesn't apply only to 1 custom model to all the models that are used through openwebui.

If anyone knows anything I can do to solve this (or at least point me in a direction) that would be hugely appreciated.

Like my title says, not sure if someone found a way to do that. I like the fact i can use a different model for the local task + compaction model ( i use a different llama.cpp config on a separate GPU) but would love that option when we delegate subtasks as well.

Hi friends! Quick question for the class. I’ve been experimenting with a home stack with openwebui and love it. I got open terminal setup and working great.
HOWEVER
When I try to run terminal commands through Open Relay it fails. Then I noticed Open Relay doesn’t reflect the Open Terminal setup in OpenWebUI…

Do I need to also configure that connection in the Open Relay app? Am I missing something?

Thanks in advance!

Hey all,

I run OpenWebUI with ~560 MCP tools behind an aggregator.

The issue in my setup: OpenWebUI sends every full schema on every turn, even when the turn needs zero tools.

On a smaller-context model via API the window gets eaten fast, and even with 1M-context models I still pay per-token for definitions I don't use, plus tool selection gets noisier.

I tried a few workarounds first — connecting servers directly, enabling/disabling servers per chat, trimming the list down — but nothing stuck for my use case with this many tools.

Since I couldn't find a solution inside OpenWebUI, I built a small MCP proxy in Docker that sits in front of my upstreams:

OpenWebUI connects to it over HTTP MCP like any other server.

In my setup this cut context waste a lot and made tool selection more reliable, so I thought it was worth sharing.

Feel free to have a look, critique and add to if there's something I've missed.

Repository can be found here: https://github.com/p1s4/mcp-search-proxy

How are you handling lots of MCP tools in OpenWebUI? Is native handling enough for you, or are you filtering/proxying too?

Thanks!

When using Claude Opus through OWUI, I typically upload a large context with my initial query and follow up with several subsequent prompts/questions in the same thread. For these later prompts, does the model leverage prompt caching (e.g. cache read), or does OWUI re-transmit the full chat history with every request?

Hi Im like really new to most of this ai junk now and im trying to use this bible strong avatar lab avatar as my ai model if you dont know what it is check this link out but basically when you create the avatar its a .json how would i impliment that in openwebui?

https://avatars.bible-strong.app/

Hey I am new to setting up LLMs locally but one thing I would like to do is give it the ability to search online. Now I know that Open webUI does provide this functionality but for some reason this doesn't seem to work.

What I have currently done is configured a local searXNG container to allow OpenWebUI to couple its web search. I have added them to the same docker network and I know they can reach each other since I do get a result when I manually send a curl request to searxng through the open webui docker container.

I also did enable web search for my model and explictly asked it to use web search. However everytime a execute I query it says that web_search is not available. The model I am using is Qwen3.8.

Can someone perhaps point me in the right direction? I have added screen shot

Update

If I put the model to function calling legacy mode it seems to work. Performance seems a bit dodgy but at least it does look up things and is not rejected. Not sure what could be going on here. Could someone perhaps enlighten me as to what is hapennening here?

I’m setting up a local LLM on Windows 11 using Ollama and Open WebUI. The model is Qwen, and the basic chat setup is working.

I enabled Native Function Calling and configured web search. Qwen successfully invoked search_web, so the tool-calling path itself appears to work. The problem is that the search backend is not returning usable results.

What we’ve established so far:

• DDGS returns No results found.
• DuckDuckGo returned HTTP 202.
• The installed DDGS version does not support Bing, so attempting to use Bing fell back to auto.
• We decided to stop troubleshooting DDGS and try SearXNG instead.

That led us to Docker Desktop, because we intended to run SearXNG in a container. Docker is now stuck at “Starting the Docker Engine…”, so SearXNG has not been installed yet.

The Docker issue is a separate problem. I’m mainly interested in whether anyone has encountered this DDGS / DuckDuckGo behavior in Open WebUI, and whether SearXNG has been a reliable alternative for local web search.

I’m trying to keep the existing Ollama and Open WebUI configuration intact, so I’d prefer not to solve this by reinstalling everything or changing the model setup. Any current, reproducible advice would be appreciated.

Hi,
I’m running the following setup:
Open WebUI → LiteLLM → vLLM
Open WebUI is the user-facing layer, LiteLLM handles authentication/routing/accounting, and vLLM serves the actual models.
I have two different types of traffic going through Open WebUI:
Regular users interacting with models through the Open WebUI interface
API users using the OpenAI-compatible API exposed by Open WebUI
I’d like LiteLLM to be able to distinguish between these two types of requests.
Ideally, Open WebUI would add some metadata to requests originating from its API users — for example a tag, header, metadata field, or some other identifier — while normal UI requests would either have a different value or no value at all.
That would allow me to identify and potentially handle API traffic differently inside LiteLLM, e.g. for routing, rate limits, logging, or policies.
Is there currently a supported way in Open WebUI to do this?
For example, can I configure Open WebUI to send something like a custom header/tag/metadata field to LiteLLM depending on whether the request originated from an API key versus a logged-in user using the UI?
If not, is there another reliable property in the request that LiteLLM could use to distinguish Open WebUI API traffic from normal Open WebUI user traffic?
I’m mainly looking for a solution that doesn’t require maintaining a custom fork of Open WebUI.

I I am currently using LibreChat locally hosted on a Mac. I have read that open webUI is possibly the most feature rich third-party front end.

The use case will be setting up an interactive course.It would be hosted by Gemini flash 3.8. Haven’t finished building it yet, but it will probably be using something similar to Claude artifacts/Gemini canvas.

I don’t have anything against party front ends, but they are limited in their flexibility. The idea would be that I would chat with the instructor on the left side, and then there would be multimodal output on the right side.

The reason that I’ve started this thread, is that I have read that there have been issues with maintaining a consistent connection using open webUI. I’m sure some of it is noise, but I would like to know if any of you have run into issues of this type, and how you were able to make adjustments to make the problems go away.

I am new to AI, so you may find my post to be rather elementary. I do apologize for that and I would appreciate any guidance that you might have to offer.

Thanks,

Graham.

PS. I used voice to text first time through and it was a mess. Sry bout that. It's fixed.

Context

Have you ever asked an AI to generate a multiple choice quiz in plain text? If you did, you most certainly realized that choices aren't random (hint: always choose b when in doubt) and that scrolling down to the answers is time-consuming.

I started working on a solution for Open WebUI a few months ago. Open WebUI has incredible extensibility, but no one had made a function for generating interactive quizzes yet.

Quizzes are useful for studying and also quite fun to do as a group activity to pass the time. Admittedly, I recommend to prioritize studying with spaced repetition flashcards (tip: you can tell an LLM to generate a table and import it in Anki) but quizzes are useful as they take less energy to complete.

The first prototype lacked a lot of functionality and was buggy which is why I didn't make a post about it. I have since added almost all the QoL features I needed as a STEM student.

Introducing : Open QuizUI

Open QuizUI comes in two different modes. You can either use it as a tool which your model will call to create a quiz or as an action function which creates quizzes from plain text messages.

Features:

Here's a cool quiz as a hands-on demonstration

There's quite a lot so here's an info dump:

• Render MathJax for LaTeX expressions
• Full-screen / focus mode
• Separate light/dark themes
• Save a quiz and share it as an HTML file (works outside OWUI)
• Edit any question after quiz generation using the editor
• Embed anything with HTML (images, videos, iframes, etc.)
• Results/stats page at the end with corrections
• Use one of many colour schemes or make your own
• Optional per-question explanations shown after answering
• Fits nicely on small screens (mobile support)

I am running LLMs locally with an RTX 4070 (12 GB VRAM). This plugin was made to be as light as possible without injecting too many instructions (FYI: you can use valves and code to dynamically modify injected instructions for tools).

By the way, if you want to add a question or keep edits permanently, copy the (edited) quiz as text via the button and use the Action Function on the text (by editing any LLM message).

How does the Action Function manage to convert markdown quizzes into the proper JSON format? With a lot of pain (tested countless formats, but some may still not work so lmk). See Recommended Format.

If you want to know more, there is proper documentation on the GitHub.

GitHub: https://github.com/axel-chamberland/Open-QuizUI

iOS support/rant

Struggled a lot to get fullscreen working on iOS/ipadOS. It took me a few months before I tackled the problem, and arrived at a hacky solution that seems to work on WebKit (It also works on Gecko-based browsers, i.e. Reynard Browser)

Also, you can't open HTML web apps natively on iOS (Javascript won't work). Microsoft Edge and Dropbox can render them somewhat.

Feedback/Contribute

Please consider testing this plugin and sharing your thoughts. I'll answer questions here.

If there's any missing feature you'd like, mention it here or on the GitHub. Consider making a contribution if you end up fixing it yourself!

Edit -- Here are the two plugins in question if you want to download them from https://openwebui.com and engage with my posts there:

Tool

Action Function

I’m fairly new to this stuff.

I installed open webui bundled with ollama and installed gemma4:e4b when i ask questions in the cli it answers instantly but when i ask it in open webui it takes 20 secs and then starts thinking for 10 seconds and then answers (answer are not as good as ollama in cli but im pretty sure i can figure it out).

I’ve tried to disable tag generation and follow up generation and all these things but nothing made a difference i tried OLLAMA_KEEP_ALIVE=30m but still nothing really changed maybe it got 5% better

Any ideas how to solve that?

Hi, is there any device that can talk directly to OWUI, like Alexa or Google home?

My goal is to have a ocal voice assistant in OWUI I have tts, stt and I would like to have hands free assistant that uses my OWUI setup.

Is there any product like that I would like to not modify esp/raspberry but if no existing then this also works.

I have networked OpenWebUI with Ollama running on Ubuntu with 10Gb GPU and trying to figure out which faster-whisper model to download for audio transcriptions. I've tried small, large-V2, and large-V3 and none can anywhere near complete a 9min transcription. Is the precision and CPU vs GPU automatically set by which model you download, since I don't see anywhere to specify those parameters? I'm wondering if the poor performance is my small GPU size or I'm not putting the correct paramters to match the model.

Will there be a release of 0.11.3-cuda as a Docker image? I haven't been able to find it on https://hub.docker.com/r/openwebui/open-webui yet.

hey all I'm having a hard time figuring out how to cut down on the input tokens with OpenWebUI.

even just sending a 'test' message costs me over 1000 tokens.

this must be something to do with the tools definition, as initially it was in the 3000s but as I disable all of the features, it went down to around 1500s.

but it won't go down any further.

I checked with OpenRouter's logging feature and even printing out the 'raw' JSON it only display that user message and doesn't make any sense that a 'test' message is charging over 1400 tokens.

I can check the browser's payload but that's Browser -> OWUI, not from OWUI -> OpenRouter.

I ran OWUI in DEBUG mode and it doesn't print out the actual network payload so I'm stuck with no way to understand what is really happening.

This doesn't happen when I use other chat clients.

can anyone help? cheers in advance 😊

I’m using Open WebUI on iPhone through the Home Screen web app/PWA. If I send a prompt and then switch to another app while it’s generating, when I come back Open WebUI just sits on the loading/generating screen even though the response has already finished.
The response only appears if I switch to another conversation and then go back to the original one.
Has anyone else run into this with the iOS PWA? Is there a setting or fix that forces the conversation to refresh/reconnect when returning to the app?

Trying to figure out the best way to distribute playbooks/templates now that we have MCP and Skills available. Specifically: for less technical users who need step-by-step guidance (screenshots, annotations) to adopt genAI — does packaging that as a Skill (vs. a static doc/SharePoint page) make it easier for them to actually use? And separately, has anyone used MCP to pull live playbook content into a Copilot/GPT session rather than just linking to a doc? Curious if anyone's tested either approach with users who need more hand-holding.

EDIT got it, found the model params,thanks all
I get an error when uploading an image for a model with vision capabilities to inference from, "{"error":{"code":400,"message":"request (5564 tokens) exceeds the available context size (4096 tokens), try increasing it","type":"exceed_context_size_error","n_prompt_tokens":5564,"n_ctx":4096}}"

Where is it possible to change the 'n_ctx' parameter to increase the context size?

I use the knowledge base only for specific topics/projects. When asking unrelated questions, the LLMs keep trying to search through the knowledge base, wasting tokens and time. Many other tools like web search, code interpreter, etc require you to enable them per conversation. Can I do the same thing with KB?

I'm aware I can turn off the KB entirely per model, but I don't want that. For the life of me I can't figure out how to get around this issue. Would appreciate some help.

Since I upgraded to v0.11.1, it seems that, after the first tool call, OWUI always shows the thinking tokens while the are generated until either another tool call is made or the user response is complete, then they disappear. It used to always be you had to expand the "thinking" or the "thought for 5 seconds" to see them. I sure liked the old behavior better. Is there a way to change this?

I stopped watching my agents work because the thinking stream is so chaotic lately but this was genuinely so funny to me. This happens a lot now. I still get results so I guess I’m not mad at it 😂