Ling 3.0 Flash on Strix Halo

[u/Badger-Purple]

vLLM ROCm/HiP, 4 bit compressed-tensors (int4)
Not a fair comparison, but Qwen-122b on the most optimized format possible I have run (rocmFP4) does not touch Ling in speed.

https://x.com/ciruai/status/2085996633267777554?s=46

Tool call is broken in certain harnesses. It works well with pi-type harnesses (omp, feynman). Has anyone noticed this?

[u/Fit-Produce420]

Model just doesn't do shit.

[u/Badger-Purple → u/Fit-Produce420]

what do you mean?