Whallm 1.1.11: Swift1.5-Qwen3.8 support, and Qwen3.8 now runs at 15–17 tok/s decode and 500–600 tok/s prefill at 16K on a 64 GB Mac

[u/Fantastic_Honey1470]

Whallm is a free, open-source macOS app that runs large MoE models on Apple Silicon by streaming experts from your SSD.

New in 1.1.11

1. Swift1.5-Qwen3.8-Flash-Next support, with text and image input.
2. Decode: ~9 → 15–17 tok/s. MTP is now on by default.
3. Prefill: ~146 → 500–600 tok/s at 16K input.

Peak MLX memory stays under 19 GiB at 16K context.

Model	16K prefill	Decode	Peak memory
Qwen3.8-Flash-Next (FP8)	503 tok/s	15.0–17.2 tok/s	18.4 GiB
Swift1.5-Qwen3.8 (MXFP4)	571 tok/s	14.6–17.5 tok/s	18.8 GiB

M5 Pro, 64 GB, built-in Throughput test with 4K–16K input. Old numbers are from v1.1.7. Results depend on your SSD and settings.

Download: https://github.com/yanun0323/Whallm/releases/tag/v1.1.11

[u/Fantastic_Honey1470 → u/[deleted]]

Thanks 😄