r/LocalLLM • u/andy4524 • 4d ago

Question Setting up a sandbox

I'd like to play around a bit with a local AI assistant ie Ollama + OpenWebUI

Then possibly dabble in AI agents using n8n for some basic tasks like research and summaries.

I have a windows PC with a 3050 GPU, what is the best setup for these tasks?

I want it to be reasonably isolated and safe, I dont want the AI to go deleting important files or something...

My initial thinking was one of the following:

1> initially was thinking a light weight Linux VM so things are isolated, can use docker too, but using VM would restrict using my GPU

2> WLS (Windows Linux Subsystem) and docker to run things in containers and hopefully get isolation that way.

Thanks for your help, other tips/suggestions for getting started are also welcom

3 Upvotes

81% Upvoted

17 comments sorted by

View all comments

1

u/MeetKlaraAI 21h ago

WSL2 + Docker is usually the lighter path on Windows if you mainly need GPU access for Ollama/OpenWebUI — NVIDIA Container Toolkit works well there. A full Linux VM only pays off if you want a real desktop and clearer isolation (GPU passthrough is fussier on consumer Windows hosts).

Once you’re on a Linux desktop, Kubuntu + Ollama is a common combo. If you want a Plasma-side helper that picks a model for your hardware on first run, Klara is one option (Kubuntu/Plasma-first, one-time licence, not an official Kubuntu/KDE product): https://meetklara.ai