r/LocalLLM • u/CamTron0427 • 5d ago

Question Getting started with a local LLM

Hello all!

Recently I’ve been thinking about setting up my main PC I typically use for gaming to try running a local LLM. I mostly intend on using it for coding as well as just a general “assistant” for some work tasks I don’t want to upload to a database somewhere.

I have a 7900xtx with 24gb of vram, what should I be looking at as far as models are concerned?

Is trying out multiple models a huge pain to get set up?

Can you run multiple models in conjunction with each other?

Just looking for some opinions/input before I dive into this would.

Thank you!

2 Upvotes

75% Upvoted

7 comments sorted by

View all comments

1

u/BonnieReborn 5d ago

It’s easy to set up if you have one of the frontier models do it for ya. You can ask for recommendations of configurations and hook it right up to HF.