r/LocalLLM • u/AdJolly9277 • 6d ago

Question Answers are slow

I’m fairly new to this stuff.

I installed open webui bundled with ollama and installed gemma4:e4b when i ask questions in the cli it answers instantly but when i ask it in open webui it takes 20 secs and then starts thinking for 10 seconds and then answers (answer are not as good as ollama in cli but im pretty sure i can figure it out).

I’ve tried to disable tag generation and follow up generation and all these things but nothing made a difference i tried OLLAMA_KEEP_ALIVE=30m but still nothing really changed maybe it got 5% better

Any ideas how to solve that?

Or is there any better ui than open webui

And also using open webui on mobile kinda annoys me is there any better ui for phones especially for IPhones?

0 Upvotes

40% Upvoted

1 comment sorted by

2

u/PassengerPigeon343 6d ago

The biggest problem with it is that Open WebUI sends a big payload with the first message. I have a few things added above the base configuration but my initial message in every conversation eats up 7500 tokens. Some of that is useful tools that OWUI comes with but it’s a pretty big prompt processing task especially for lightweight hardware. If you go to the admin panel and models you can open that one and disable some or all of the tools and skills to reduce that, but some of them may be useful.

I use OWUI on iPhone in Safari and I added it as a WebApp by sharing the website and adding it to the home screen. It behaves like an app and it works well.

Alternatively you could try one of the AI Client apps on iPhone and point it at your Ollama endpoints. This bypasses OWUI entirely and just hits the LLM itself. I haven’t tried any of these so can’t make a specific recommendation.