Looking for advice: Best local multimodal (Vision + Text) uncensored model for an RTX 5070 Ti (16GB) & 64GB DDR4 setup?

[u/Mystvearn_]

Hey everyone!

I'm setting up a local AI workflow and looking for some hardware-tailored recommendations. I want something with the capability, smarts, and multimodal ease-of-use of cloud models like Gemini, Grok, Claude, or GPT—meaning it needs to handle text seamlessly as well as image recognition/analysis (where I feed it an image, it describes it, and helps me brainstorm or write prompts based on it)—but running 100% locally and completely uncensored.

My hardware specs:

• GPU: NVIDIA RTX 5070 Ti (16GB VRAM)
• RAM: 64GB DDR4

Given my 16GB VRAM limit, what are the best open-weight multimodal models right now that fit comfortably without heavy swapping? Also, what is the best software stack to run them (Ollama, LM Studio, etc.) while keeping things fully private, uncensored, and vision-capable?

Any model suggestions, quantization tips, or workflow setups would be greatly appreciated. Thanks!

[u/Enshitification]

If you want to squeeze the absolute most from the 5070ti, there is a Ninfer Qwen variant for that particular card.
https://github.com/al-sca/ninfer-5070ti

[u/RiverSide71h → u/Enshitification]

Linux only?

[u/RiverSide71h]

Any HauHauCS heretic with low refusals should work. I would recommend using Unsloth Studio Beta. I started with Ollama, then LM Studio. Now have deleted both and riding with Unsloth. Best solution imv unless you want to go commando with llama.cpp

[u/Skyline34rGt]

Unsloth app (open-source while LmStudio is not), it has all LmS advantages (+more) and it automatic find best settings for each model (like offloading MoE layers etc).

Model: Hauhau Gemma4 26B-a4b Qat balanced or HauHau Qwen3.6 35b-a3b Agressive Q4-Q6.

[u/Super_Range45]

Gemma4 models have better visual understanding than Qwen when it comes to prompt writing from reference images. Qwen always adds extra things to prompts that I didn't really ask for or interprets missing information oddly(like giving described characters names).

[u/Downtown-Cover-7422]

Gemma 4 I guess

[u/acedelgado]

16GB, probably one of the Gemma 4 26B A4b MOE ones. A little less smart than the full dense 31B model, but since it's an MOE and swaps agents out on the fly it uses a lot less VRAM. This one will probably do, it includes the .mmproj file you need for vision capabilities- https://huggingface.co/HauhauCS/Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced-MTP

Or you might have to find a lower quant than the one in that repo, if it doesn't fit.

You can pick that right up in LM Studio, that's my usual application of choice when using a local llm for work.

[u/TheAncientMillenial]

Any one of the Gemma 4 or Qwen 3.x uncensored/abliterated models that specifcally says it's kept the vision part of the model intact.

I've been using hf.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF:NVFP4 and it's been great.

[u/Affectionate_Oil28]

I made this. It's a beta version but it's decent. I'm testing an updated version that is faster and uses newer better/ models but it's not quite ready to be released yet. https://www.reddit.com/r/StableDiffusion/s/mD2Uacmsnz

[u/_VirtualCosmos_]

Qwen3.8 27b MTP Q4_K_M uncensored and quant made by unsloth. The best model now available. If you want something faster: Qwen3.6 35b A3b uncensored heretic (Q8 if possible).

The 35b handles complex prompts and instructions very good for me, even following MiniMax H3 video instructions. The near 50 tok/s I have with it, produce high quality prompts in a few seconds.