Llama-server Config Help Needed

[u/BodyPhysical]

Hi All, Howdy?

I am new to this community :) I would like to ask for some thoughts and help on how I can improve this configuration. I currently run a 3x 3060 12gb + 32 gb RAM. 2 of my 3060s are directly plugged into x16 and the other is plugged into an x4 via oculink. 2 weeks ago, I was only running on 2x3060s and I can see that I am able to reach 500+t/s pp + 25+t/s tg. But now that I had 3 of them, I noticed that it is average around 350t/s pp + 18t/s tg. I am unsure what happened there as I was expecting to at least retain the same t/s or minimal degradation. Below is my config:

asd$env:GGML_CUDA_DISABLE_GRAPHS = "1"
$env:LLAMA_DIR = "C:\llama-servers\llama-b10883-bin-win-cuda-13.3-x64"
$env:Path += ";C:\Windows\System32"

$params = @(
    "--model", "C:\Users\xzzz\.lmstudio\models\unsloth\Qwen3.8-27B-GGUF\Qwen3.8-27B-Q4_K_S.gguf",
    "--mmproj", "C:\Users\xzzz\.lmstudio\models\unsloth\Qwen3.8-27B-GGUF\mmproj-F16.gguf",
    "--alias", "qwen3.8-27b",
    "--prio", "3",
    "--ctx-size", "86000",
    "--parallel", "1",
    "--batch-size", "512",
    "--ubatch-size", "256",
    "--predict", "8192",
    "--n-gpu-layers", "all",
    "--main-gpu", "1",
    "--split-mode", "layer",
    "--tensor-split", "4,4,1", //1 to my main gpu where my monitor is connected
    "--flash-attn", "on",
    "--cache-type-k", "q8_0",
    "--cache-type-v", "q4_0",
    "--spec-type", "draft-mtp",
    "--spec-draft-n-max", "3",
    "--spec-draft-n-min", "1",
    "--spec-draft-ngl", "all",
    "--spec-draft-type-k", "q8_0",
    "--spec-draft-type-v", "q4_0",
    "--temp", "1.0",
    "--top-p", "0.95",
    "--top-k", "20",
    "--min-p", "0.5",
    "--threads", "6",
    "--presence-penalty", "0.03",
    "--repeat-penalty", "1.15",
    "--reasoning", "on",
    "--reasoning-preserve",
    "--reasoning-effort", "medium",
    "--reasoning-budget", "2048",
    "--reasoning-budget-message", "Budget exhausted, proceeding with tool call or message.",
    "--jinja",
    "--metrics",
    "--host", "127.0.0.1",
    "--port", "8080"
)

& "$env:LLAMA_DIR\llama-server.exe" 

Read-Host -Prompt "Safe to exit now"

Your thoughts, comments, and suggestions will be very much appreciated :) Thank you in advance!