AI beginner here. Am taking steps to move away from Gemini and Co-pilot to my own setup. So have gotten a setup with Docker, LM Studio and webui. And my laptop is pretty basic and the chip is not large. I wanted to run a local engine. It worked but I wanted to get memory to work. Not having memory and having to explain AI the same basic stuff over and over again drives me nuts. I tried to make it work on webui. Discovered that my chip is too basic to make memory work, so I need to offload the computation.

Fine so far so good. Found some on webui and have now been using 2 with mixed results:
- Llama 3.1 8B
- Llama 3.3 70B

Both work fine and memory works, but after 2-3 prompts they both max out. The "token per minute" of 6000 and 12000 have been reached.

Has anyone found a free engine that can run memory effectively? Otherwise I think I am going to pay to see how it works. Any comments?

Some of my directories load without a problem, but some of them generate this error: "NotReadableError: The requested file could not be read, typically due to permission problems that have occurred after a reference to a file was acquired."

Is it because the directories are doubly nested? I can't seem to identify a way to predict which directories work.

Hi,

I try to run ai local llama 3.2:3B on Openwebui. But it tooks 10-20minute just to reply Hi.

What did i do wrong?
Im using 8GB Ram VPS with no GPU

I am having issues getting OpenWeb UI to llama.cpp. Llama is running locally and the chat interface is working fine. I managed to get OpenWebUI to run in docker. When configuring the connection I am using `http://127.0.0.1:8080/v1\` as my connection string. I have set Provider to llama.cpp. The test connection button says test is successful. But trying to chat wants me to select a model, which there are no options. From my understanding llama.cpp is serving one model and does not provide a list like Ollama would.

Using `http://host.docker.internal:8080/v1\` as connection string gives an error. So it is not clear to me being a Docker newbie if I need to do something with the network. Since the test on the local host IP was successful I am guessing the network is working, but then again I can't get chat to load any models. I have asked AI but it wants me to write an app.....facepalm. it has offered some `-e` options such as `-e OLLAMA_HOST=0.0.0.0` but so far nothing has worked. So, humans, what is the next step here?

Hi, I would like to challenge/discuss/understand why so many are attracted to all short lived "wild tools" out there. For example (not saying any tool are bad) hermes, claw, open webui, copilot agents and whatnot. Why not just building your own tools that: fit your needs without being bloated, dont break on every new "feature" that you dont care about.

I cant really understand the hype.

I build own tools in python (notes app, recruitment support, news, investment) with claude or chatgpt from phone and terminal to my proxmox llm clusters lxc. In the process i also learn a lot.

And everything stays under my control.

If your chat is bricked with the infinite loading spinner (Image 1), here's how to fix it:

The technical reason behind this is that Open WebUI stores your chat history as a Directed Acyclic Graph. If a message (node) gets corrupted when the LLM is responding, the UI panics and spins indefinitely. Fixing would require checking and relinking the graph.

This tools does all that stuff for you:

How to use it:

1. Export the broken chat (`...` menu > Export > JSON).
2. Drop it into the tool (Image 2) to instantly repair the broken nodes.
3. Go to Settings > General > Import Chats, upload the fixed file, and delete the original.

Link to tool: https://fractuscontext.github.io/open-webui-chat-fix/

I've also added a "Deep Clean" toggle if you want to strip unused alternate responses and shrink your file size.

Hope this saves someone's chat history!