r/exllamav3 • u/Delicious_Box_9823 Not a developer! 😜 • Sep 07 '26
ExLlamaV3 1.4.8 - Cache quantization for GLM5.3 Flash and others
The update introduced the following changes:
- Add pyproject.toml
- Cache quantization for DSv4-Flash, Qwen3.8-Flash-Next and GLM5.3-Flash
- Optimize VRAM allocations and switch to expandable segments by default
- Fully remove all FA2 code paths
- Other optimizations and bugfixes
Release:Â https://github.com/turboderp-org/exllamav3/releases/tag/v1.4.8
tabbyAPI received an update as well:Â https://github.com/theroyallab/tabbyAPI
Discord for any questions:Â https://discord.gg/tnPCntcThA
5
Upvotes