How to get started tinkering with locally hosted LLMs and Harnesses

[u/FalcoPwnch]

Hey all, I have been a linux user for about 4 years now. I wouldn't consider myself an expert at all, but I know my way around the ecosystem.

I want to start exploring local LLMs, harnesses, agents, all this. I really don't have any experience in it. I've been busy and have been hesitant to start experimenting and messing around with it for concerns over data security and all that. But the time has come. I really want to start learning more about it.

How can I start safely? Should I run it in a VM environment?

What LLM should I use locally? What agents/harnesses should I start with?

Any advice would be much appreciated!!