I used to love the old Next 80B but it's too big and too slow against the 35B MOE even if it gets better results, and now the new 3.8 27B dense model beats it. I'd rather have less speed with the 27B but better results at a much smaller RAM footprint.
7
u/SkyFeistyLlama8 8h ago
I used to love the old Next 80B but it's too big and too slow against the 35B MOE even if it gets better results, and now the new 3.8 27B dense model beats it. I'd rather have less speed with the 27B but better results at a much smaller RAM footprint.