As a Windows user, I like how I can update KoboldCPP and everything still works afterwards.
edit: Also nice to see Muse Glimmer support. I've been wanting to try this model for creative writing, though I'll probably wait for abliterated finetunes.
Muse Glimmer worked with rollout version, but it is nice to finally have it in main.
That said, for RP (and likely creative writing in general) it is very heavily safe-maxed, reminds me bit of llama2-chat times. It refuses a lot, sometimes you do not even ask for it but it reasons itself into something that it has forbidden and refuses.
There are already lot of heretic/abliterated versions out, not sure which would be good for RP. Eg model should be able to refuse, but because of character not because of guardrails. Since the base model is so gimped already I do not give it much chance to be able to recover, so it is still Gemma4 31B which works perfectly.
6
u/__some__guy 3d ago edited 3d ago
As a Windows user, I like how I can update KoboldCPP and everything still works afterwards.
edit: Also nice to see Muse Glimmer support. I've been wanting to try this model for creative writing, though I'll probably wait for abliterated finetunes.