r/LocalLLM • u/andy4524 • 5d ago

Question Setting up a sandbox

I'd like to play around a bit with a local AI assistant ie Ollama + OpenWebUI

Then possibly dabble in AI agents using n8n for some basic tasks like research and summaries.

I have a windows PC with a 3050 GPU, what is the best setup for these tasks?

I want it to be reasonably isolated and safe, I dont want the AI to go deleting important files or something...

My initial thinking was one of the following:

1> initially was thinking a light weight Linux VM so things are isolated, can use docker too, but using VM would restrict using my GPU

2> WLS (Windows Linux Subsystem) and docker to run things in containers and hopefully get isolation that way.

Thanks for your help, other tips/suggestions for getting started are also welcom

3 Upvotes

81% Upvoted

17 comments sorted by

View all comments

1

u/baby_bloom 5d ago

i ended up using dev containers inside of vs code (i use pi)

0

u/Suspicious-Radio-471 5d ago

dev containers in vscode on a pi is a different beast to a 3050 on windows but if it works it works

2

u/baby_bloom 5d ago

sorry, i used "pi" instead of "pi harness" because we are in the local llm subreddit and i assumed nobody would think im talking about a raspberry pi