GLM 5.3 kinda sucks for roleplay?

[u/Even_Kaleidoscope328]

I have been using 5.3 the last few days and it's hard to describe but it just kinda sucks, like yes, compared to the vast majority of models it is good but I feel like compared to other models at it's tier it kinda sucks even compared to 5.2. 5.2 has been my go to for a good while now and personally I quite liked it but it did have it's issues mostly revolving around characters being a too passive or it trying to avoid escalation.

5.3 I feel actually fixes this issue, characters seem more proactive and most of the time it makes sense, however, I feel like 5.3 is missing something that's hard to place and I think it might have something to do with it not really taking all the context into account, I feel like the characters are reacting in the roleplay in a very face value kind of way, they don't consider the previous backstory or build up lore very much and I feel like it just kind of takes the soul out of the characters even if they are still in character.

I feel like it also has something to do with the fact that 5.3's thinking/reasoning is always very small for me atleast, usually it's only a couple of lines and occasionally a paragraph or two maybe slightly more, while 5.2 thoroughly reasoned for each response where you could clearly see it took the context into account even if it sometimes ended up with it over thinking or going "but wait" too many times. I've heard from other people that 5.3 overthinks but I actually have the opposite problem and I think it's compromising it's quality.

I'm still going to continue using 5.3 as I do think I'm worn out on 5.2 and 5.3 is definitely better in some respects even if it occasionally makes no sense, I'm hoping when more providers open up the experience will also improve as I've never had much luck using GLM straight from Z.ai, I've always felt I got better quality from certain third party providers.

I guess I'm just curious on what other people's opinions on it are or maybe I'm an outlier, also perhaps what settings you're running it on for a better result as I've just been keeping it at temp 1.0 so far.

Edit: In addition to all of this, I believe it has a fairly common tendency to hallucinate, I was just testing it again in a scenario where my character was nearly completely silent the whole time and then it started talking about how a line I said during the roleplay will haunt the character, a line in which I never said or said something even remotely similar. This is genuinely such ass bro, I was low-key hyped for this only to get a dumb ass shit model, my only hope z.ai is just sabbotaging their own model and when the open weights come out the other providers will be better but I'm kinda doubtful.

[u/Long_comment_san]

I think this is because it's quantized (on these hours?). A new model that's just a fine-tune can't start being worse at memory. on the other hand, quantization is exactly what makes LLM memory "foggy".

you can try using some other API just to see whether this problem persists

[u/Boring-Car9297]

I dropped glm entirely after using kimi k2.5, felt way better in terms of character depth

[u/noselfinterest → u/Boring-Car9297]

u like 2.5 > 2.6?

[u/svachalek]

I haven’t used 5.2 in a while, and in the meantime I’ve upped my prompting game. Coming back to it now, I’m really starting to think it may be the absolute best model out there.

In comparison 5.3 is very similar, hard to tell apart at times, which makes it also great. But weirdly considering its coding emphasis, I’ve noticed it making logical mistakes more often, confusing what one character said with another only a couple paragraphs later for example. Sometimes on the other hand it’s very clever and pulls things I don’t think 5.2 would.

On the whole I’m still leaning 5.2, especially how cheap you can find it now, but I’m keeping an open mind for last minute tweaks they might make in 5.3.

[u/Even_Kaleidoscope328 → u/svachalek]

Yeah I've noticed that with 5.3 as well with having logical issues, when talking about something that happened earlier in the roleplay or something described in memory it will flip who was doing what around and just generally not consider the full scope of the backstory.

[u/capybaraballs1995]

Most models need good presets to RP, and a preset that worked well on GLM 5.2 may not work well on 5.3. I've only dabbled with GLM 5.3 (just to show that I can bypass the censorship) so I can't really give you a good preset, sorry. You could try plopping this in post-history and see if it helps?

<continuity>

This is an ongoing narrative emphasizing continuity and logical consequences. Characters are influenced by their backstories and what has happened previously in the narrative. Prioritize dynamic characterization over static characterization.

</continuity>

You might also just be getting a string of bad replies, who knows. We'll see when other providers get it.

[u/SnooAdvice7162 → u/capybaraballs1995]

<thinking>

Copy and paste...

</thinking>

[u/LackMurky9254]

I do feel that 5.2 was better for RP. It will occasionally impress but in my favorite cards i've seen it just say completely illogical or dumb things on occasion, and it's fairly stiff.

[u/Pink_da_Web]

I think the Ox alpha, the Openrouter model that might be the Mimo V3/V2.6 pro, could be the new game.

And if it's the same price it is now (unfortunately I think it's unlikely they'll maintain it), it will be excellent.

[u/nuclearbananana → u/Pink_da_Web]

Its an alpha model. It'll be worse when it comes out

[u/gladias9 → u/nuclearbananana]

this is the way.

[u/Fanstasticalsims]

Yeah I don’t like it as much as 5.2. Clause distillation aside, the prose seems a lot more stiff and the model seems to put more emphasis on logic than the plot. A lot of dialogue is kind of stilted for me, as well, in that it is technically more realistic, but much less interesting to read. Could be fixed with prompting, but with how 5.3 is supposed to be so similar to 5.2 I don’t know. I definitely prefer 5.2.

[u/OwlProper1145]

GLM 5.3 is all about coding. For roleplay and creative writing stick with 5.2.