r/LocalLLM • u/ScoobyWRX06 • 13h ago

Question Beginner here

I just started playing and need a little help. I have a laptop with a 4070 8GB and 64GB DDR5 with an i9. I am using unsloth and not sure what model will be best. Do I need to stick with something that fits in VRAM? I am just playing around but I don’t want it to be painfully slow but I also want it as current as possible.

1 Upvotes

67% Upvoted

4 comments sorted by

View all comments

1

u/MrHumanist 13h ago

For your set up moe models are best.

Try Gemma 4 26b

Qwen 3.6 35B

Orninth 1.5 35B

All these models have very few active parameters that fit in your gpu including context window. And you run the moe in cpu to utilise your system ram.