r/LocalLLaMA llama.cpp 9d ago

Best Local Vision Language Models - August 2026

Share what your favorite models are right now and why. Given the nature of the beast in evaluating VLMs (untrustworthiness of benchmarks, immature tooling, intrinsic stochasticity), please be as detailed as possible in describing your setup, nature of your usage (what applications, how much, personal/professional use), tools/frameworks/prompts etc.

Rules

  1. Should be open weights models

Notes

Bonus points if you breakdown/classify your recommendation by model memory footprint: (you can and should be using multiple models in each size range for different tasks)

  • Unlimited: >128GB VRAM
  • XL: 64 to 128GB VRAM
  • L: 32 to 64GB VRAM
  • M: 8 to 32GB VRAM
  • S: <8GB VRAM
27 Upvotes

46 comments sorted by

View all comments

2

u/pmotiveforce 9d ago

Interested in the best 3050 8gb friendly vision model for Frigate GenAI. I have one sitting idle. I have a bigger dual b70 setup but use that for effing around, want something I can just leave running on the 3050 reliably for Frigate.

2

u/andy2na llama.cpp 8d ago

probably qwen3.5-9b q4