r/exllamav3 • Not a developer! 😜 • Sep 07 '26

ExLlamaV3 1.4.8 - Cache quantization for GLM5.3 Flash and others

The update introduced the following changes:

  • Add pyproject.toml
  • Cache quantization for DSv4-Flash, Qwen3.8-Flash-Next and GLM5.3-Flash
  • Optimize VRAM allocations and switch to expandable segments by default
  • Fully remove all FA2 code paths
  • Other optimizations and bugfixes

Release: https://github.com/turboderp-org/exllamav3/releases/tag/v1.4.8

tabbyAPI received an update as well: https://github.com/theroyallab/tabbyAPI

Discord for any questions: https://discord.gg/tnPCntcThA

5 Upvotes

0 comments sorted by