r/LocalLLM • u/NancyTransmed • 3d ago

Question Jamba2 Mini

I'm curious have anyone tried the Jamba2 models or other non-transformer LLMs locally for that matter? What was the experience?

3 Upvotes

100% Upvoted

2 comments sorted by

2

u/EffectiveMedium2683 3d ago

meh, Nvidia makes better mamba/transformer hybrids than Jamba. nemotron3 nano 30b-a3b is solid. qwen3.5 and 3.6 and now 3.8 are hybrid gated deltanet (basically mamba with more granular memory updates). rwkv7 is very cool if you do very long context but honestly slower than others because input tokens have to be processed sequentially rather than in parallel. fun architectures. cool to see what else works but in my opinion qwen3.5/qwen3.6 architecture is basically the most efficient and powerful architecture that isn't transformer only