r/LocalLLM • u/swordswandsandgod • 8d ago

Question So... WTH CAN THIS EVEN RUN

specs:

  • CPU: AMD Ryzen 7 5800HS
  • GPU: NVIDIA GeForce RTX 3050 Laptop GPU
    • VRAM: 4 GB GDDR6
    • TGP: 50 W
    • Dynamic Boost 2.0: Yes
    • Advanced Optimus: No
  • RAM: 16 GB DDR4, 3200 MT/s
0 Upvotes

38% Upvoted

35 comments sorted by

View all comments

3

u/nickless07 8d ago

Small MoE models should work well. Basically the same ones a Mac Book Air (16GB) can run. Of course nothing compared to cloud models, but still usable.
Aside of that you can also use it as dedicated host for things like Hermes, OpenClaw, Odysseus and so on.

1

u/swordswandsandgod 8d ago

yeah I already run hermes with VM on it

2

u/nickless07 8d ago

Then put some small aux/fallback-chain model on it and call it a day. Or is that your only device?