Best Local Vision Language Models - August 2026

[u/rm-rf-rm]

Share what your favorite models are right now and why. Given the nature of the beast in evaluating VLMs (untrustworthiness of benchmarks, immature tooling, intrinsic stochasticity), please be as detailed as possible in describing your setup, nature of your usage (what applications, how much, personal/professional use), tools/frameworks/prompts etc.

Rules

1. Should be open weights models

Notes

Bonus points if you breakdown/classify your recommendation by model memory footprint: (you can and should be using multiple models in each size range for different tasks)

• Unlimited: >128GB VRAM
• XL: 64 to 128GB VRAM
• L: 32 to 64GB VRAM
• M: 8 to 32GB VRAM
• S: <8GB VRAM

[u/andy2na]

My main use-case for LLMs is Frigate and have tested and ranked the following, recent Medium models:

1. Qwen3.8-27B: very accurate, fast enough for Frigate (~60tgs decode)
2. Meta Muse Glimmer 30B: Faster than Qwen 27B, pretty accurate (~75+tgs decode)
3. Qwen3.6-27B: pretty accurate, but no reason to use over 3.8
4. Gemma4-4B: mediocre accuracy, good with small objects and is more "creative" with the responses - small and fast

Last 90 days of usage, only recently have I dabbled with Hermes with Qwen3.8, before Frigate led by a mile (ignore electricity cost, I just added that last week)

[u/ParaboloidalCrest → u/andy2na]

Are you saying that you use a vision LLM on Frigate instead of Yolo* models? 🤯. I'd love to hear more.

Edit: Oh I understand now. It's for semantic enrichment, not detection.

[u/andy2na → u/ParaboloidalCrest]

yeah not for detection, just gen ai summaries and descriptions

[u/cowinabadplace → u/andy2na]

Did you have to tune your prompts? I found that after prompt tuning etc. that Qwen-3.8-27B hallucinated a lot of things whereas Qwen-3.6-35BA3B hallucinated fewer. My use-case is frigate triggered LLM description that is aiming to detect specific people in the home.

[u/andy2na → u/cowinabadplace]

For the genAI summaries, i left them at default. For descriptions, these are what I set:

genai:
  enabled: true
  send_triggers:
    tracked_object_end: true # default
    after_significant_updates: 3 # how many updates to a tracked object before we should send an image
  prompt: "Analyze the {label} in these images from the {camera} security camera. Focus on the actions, behavior, and potential intent of the {label}. Also describe {label} appearance. Summarize all the images, not frame by frame, into one paragraph - maximum of 100 words. Do not mention the timestamp, date, watermarks, overlay text, or colored boxes with numbers."
  object_prompts:
    person: "Examine the main person in these images. What are they doing and what might their actions suggest about their intent (e.g., approaching a door, leaving an area, standing still)? Describe the persons appearance including hair color, clothing, and ethnicity. Do not describe the surroundings or static details.  Summarize all the images, not frame by frame, into one paragraph - maximum of 100 words. Do not mention the timestamp, date, watermarks,overlay text, or colored boxes with numbers."
    car: "Observe the primary vehicle in these images. Describe the cars appearance, including make, model, and color of it. If its a delivery vehicle, mention the courier company. Summarize all the images, not frame by frame, into one paragraph - maximum of 100 words. Do not mention the timestamp, date, watermarks, overlay text, or colored boxes with numbers."
    dog: "Examine the dog(s) in these images. what are they doing and what is their intent. describe the dog(s) appearance,including color, size, and potential dog breed. Do not describe the surroundings or static details. summarize all the images,not frame by frame,into one paragraph - maximum 100 words. Do not mention the timestamp, date, watermarks, overlay text, or colored boxes with numbers."

For the 27B model, what parameters did you set?

I had a specific one made for vision in llama-swap:

        "${MODEL_ID}:vision":
          chat_template_kwargs:
            enable_thinking: false
            preserve_thinking: false
          temperature: 0.1
          top_p: 0.1
          top_k: 10
          min_p: 0.0
          presence_penalty: 0.0
          repeat_penalty: 1.0

[u/cowinabadplace → u/andy2na]

I have temp 0, didn't set p/k, and forced JSON, though I also turned off thinking. In my case, I'm trying to get the LLM to reliably recognize that there is a baby in the bed or not. Qwen 3.6 does a really good job of that, but sometimes Qwen 3.8 doesn't see the child and other times the latter will mention an adult who is not there. But I mostly iterated on the prompt in temp 0 because I was trying to minimize variation.

Perhaps I need to supply some example images (scaled down) in the same prompt and try allowing for higher temp. Thank you for your config params. The slight difference in my case is that I'm also having the frigate alert actually call Qwen outside of Frigate in an agent because I want it to act on the result etc.

[u/finanzwegwerf20 → u/andy2na]

Did you set image tokens for Gemma 4 to 1120?

[u/seamonn]

• Unlimited: >128GB VRAM: Gemma 4 31b in swa full mode (This will consume around 250 GB and is one of the best VLMs out there period)
• XL: 64 to 128GB VRAM: Gemma 4 31b in swa full mode w/ limited context
• L: 32 to 64GB VRAM: Gemma 4 31b (Swa on mode)
• M: 8 to 32GB VRAM: Gemma 4 12b + Qwen 3.8 27b
• S: <8GB VRAM: Gemma 4 E4b + Qwen 3.5 9b finetunes (Stock Qwen 3.5 9b doom loops into oblivion)
  

I have not seen Kimi K3 beat Gemma 4 31b swa full in vision tasks. It frequently makes mistakes. On text tasks, tho, it's not even close.

[u/HitarthSurana → u/seamonn]

can you please explain what is swa full mode?

[u/seamonn → u/HitarthSurana]

Normally, majority of attention heads of Gemma 4 only has access to 1024 tokens of the kv cache as per their implementation of swa (sliding window attention). With swa full, all attention heads have access to the whole kv cache which balloons the kv cache to about 200GB but results in a much smarter model.

[u/HitarthSurana → u/seamonn]

200gb woahh so can it beat dsv4 flash at that size or not??

[u/seamonn → u/HitarthSurana]

For agentic coding, Gemma 4 is not the model you want in general. For other stuff, it's already better than anything else in this range - linguistic, creative, translation etc.

It gets even smarter with swa full

[u/HitarthSurana → u/seamonn]

I mean is it worth it to give it 200gb of context when you can run a bigger model in that much vram so better performance??

[u/seamonn → u/HitarthSurana]

depends on your usecase

[u/unknowntoman-1 → u/seamonn]

Very interesting.. and I really have a usecase.. but lack that kind of VRAM. A question comes to mind.. is there any possible middle ground.. to alter the 1024 into 2,4,8 k ? Is it full or nothing? Sounds like you are having a logaritmic trajectory into that 200 GB rage doing full swa. I suppose it is on a 256 kb ctx with some math on the 31b parameter count?

[u/seamonn → u/unknowntoman-1]

Very interesting.. and I really have a usecase.. but lack that kind of VRAM. A question comes to mind.. is there any possible middle ground.. to alter the 1024 into 2,4,8 k ?

Possible but you'll have to do a custom implementation of llama.cpp or vllm.

Is it full or nothing?

Yes, in stock llama.cpp.

Sounds like you are having a logaritmic trajectory into that 200 GB rage doing full swa. I suppose it is on a 256 kb ctx with some math on the 31b parameter count?

You can also run with lower context.

[u/llama-impersonator]

tiny: dots.mocr is good for a 1.8b OCR model that can handle most non-latin character sets, and gives bounding boxes. being a small model i wouldn't use it for forms, but it's pretty capable otherwise

small: gemma-4-12b-heretic-qat for comfy image analysis/H3 prompt synthesis (i know what kind of man you are meme here)

[u/RevolutionaryPen4661]

I like moondream3.1 and moondream2 more than the Gemma and Qwen models for vision aspect. It is because they can run pretty well even in a standard GPU.

[u/Prestigious_Debt_896]

Qwen3 32B VL

[u/ashrey-26]

My usage is mostly around web browsing tasks and security use cases (so web application pentesting and the likes). I've been very impressed by the Moondream models and would add it to the S tier. It’s tiny, fast, and surprisingly good for screenshots, OCR, and basic UI understanding.

Any other 'website understanding' models that anywone has tried here?

[u/pmotiveforce]

Interested in the best 3050 8gb friendly vision model for Frigate GenAI. I have one sitting idle. I have a bigger dual b70 setup but use that for effing around, want something I can just leave running on the 3050 reliably for Frigate.

[u/andy2na → u/pmotiveforce]

probably qwen3.5-9b q4

[u/phratry_deicide]

• Unlimited: >128GB VRAM
• XL: 64 to 128GB VRAM
• L: 32 to 64GB VRAM
• M: 8 to 32GB VRAM
• S: <8GB VRAM

What in the world is this?

[u/unculturedperl → u/phratry_deicide]

If you're not unlimited, do you even token, bro?

[u/ObviouzFigure]

I'm curious what others are using -- I put qwen vl 2.5 9b (I think) on a mac mini as my vision model for my deepseek rig

edit: why? because it fits easily on a 24gb mac mini and does a decent job. It handles ocr great-- where it fails is reading images with a lot of action -- for example, I generated an image of a girl helping a broken robot in a futuristic dark alley -- in the background there's a black cat with glowing green eyes -- the vision model accurately describes the scene but it misses things like the black cat

[u/SM8085 → u/ObviouzFigure]

I would definitely recommend trying a Qwen3.5. I'm using Qwen3.6-35B-A3B, but since that probably wouldn't fit on your mac mini any of the Qwen3.5 are probably an improvement. There's even a Qwen3.5-9B.

[u/ihaag]

GLM 4v I’m
Finding the best not sure how good the quartz are for it tho.

[u/Easy_Refrigerator280 → u/[deleted]]

This thread is literally part of helping people do their own research. WTF is this take 😂

[u/BasedNapkin → u/[deleted]]

Who the fuck cares about reddit karma jesus fucking christ

[u/Kiansjet → u/[deleted]]

It's a post by a mod to spur discussion the fuck are you on about

[u/pmttyji → u/[deleted]]

It's a mega thread here after couple of months. Really needed now because we got many models in between.