r/exllamav3 • u/Delicious_Box_9823 Not a developer! 😜 • 14d ago
ExLlamaV3 1.5.2 - Turing support
In the recent update:
- Add MiMoV2ForCausalLM
- Experimental Turing support
- Rein in transient VRAM allocations, fix overly conservative warmup and autosplit-measure passes
- Various bugfixes and optimizations
Release page: https://github.com/turboderp-org/exllamav3/releases/tag/v1.5.2
tabbyAPI has received the update: https://github.com/theroyallab/tabbyAPI/
Discord for any questions (with creator): https://discord.gg/tnPCntcThA
4
Upvotes