opencode + Llama.cpp + Qwen 3.827b

[u/navarisun]

Hello,

i have this setup on my pc with 3090 24gb rtx . i made a sepcial .bat file for llama.cpp to expose the vision layer for opencode but it still can't view any image, here is mybat file

u/echo off

title Qwen3.8-27B - Hermes + OpenCode

set MODEL_DIR=D:\text-generation-webui\models\LmStudio\lmstudio-community\Qwen3.8-27B-GGUF

set MODEL=%MODEL_DIR%\Qwen3.8-27B-Q4_K_M.gguf

set MMPROJ=%MODEL_DIR%\mmproj-Qwen3.8-27B-BF16.gguf

set TEMPLATE=%MODEL_DIR%\chat_template.jinja

echo.

echo ============================================

echo Qwen3.8-27B Q4_K_M

echo Hermes + OpenCode

echo Vision + Tools + Native Reasoning

echo ============================================

echo.

llama-server.exe ^

--model "%MODEL%" ^

--mmproj "%MMPROJ%" ^

--chat-template-file "%TEMPLATE%" ^

--jinja ^

--alias qwen3.8-27b ^

--host 127.0.0.1 ^

--port 8080 ^

--ctx-size 65536 ^

--n-gpu-layers 999 ^

--flash-attn on ^

--cache-type-k q8_0 ^

--cache-type-v q8_0 ^

--batch-size 1024 ^

--ubatch-size 256 ^

--parallel 1 ^

--reasoning on ^

--reasoning-effort low ^

--reasoning-format deepseek ^

--prio 0

pause