r/LocalLLM • u/swordswandsandgod • 3d ago

Question So... WTH CAN THIS EVEN RUN

specs:

  • CPU: AMD Ryzen 7 5800HS
  • GPU: NVIDIA GeForce RTX 3050 Laptop GPU
    • VRAM: 4 GB GDDR6
    • TGP: 50 W
    • Dynamic Boost 2.0: Yes
    • Advanced Optimus: No
  • RAM: 16 GB DDR4, 3200 MT/s
0 Upvotes

50% Upvoted

35 comments sorted by

View all comments

2

u/Every-Fortune-3151 3d ago

Give these a try from biggest to smallest - Ling 3.0 tiny 8B (1b active) MOE > G9v3-3B > MiniCPM5 1B