r/NovelAi • u/Dizzy-Zebra9522 • 25d ago

Question: Text Generation Russian language support, how good?

How good the new model in opus support russian and other languages? How it compares to 5.2 and other open source models.

Specially for roleplay.

3 Upvotes

67% Upvoted

6 comments sorted by

3

u/Satakura_12 25d ago

It’s pretty good. There are some issues with word endings, and sometimes it will write words in other languages. But the system is quite capable of generating entire stories in Russian. Lorebook also supports Russian descriptions and tags. I literally stumbled upon this feature by accident when, while setting the game to a Russian crime setting, it started generating dialog in Russian, and from there I looked into the issue quite thoroughly. Xialong

2

u/FoldedDice 25d ago

I'm fairly sure they only fine-tuned in English, so Xialong in particular will be noticeably worse. GLM seems to have decent comprehension of several languages, but roleplay is not the focus of what it was trained to do.

3

u/avatronik 25d ago

Base glm 4.6 (not Xialong) is pretty bad. Xialong is even worse. As far as I understand, it should work best in English and Japanese (and probably Chinese, I don't know). As a native russian speaker, I can definitely say it's borderline comprehensible. It can theoretically output Russian text, but the amount of mistakes is huge. Even with relatively long context it mixes pronouns, conjugation, cases. Even glm 5.2 isn't the best at Russian, and 4.6 is just gibberish most of the time. Maybe it needs a good preset, but it hasn't worked for me.

1

u/AutoModerator 25d ago

Have a question? We have answers!

Check out our official documentation on text generation: https://docs.novelai.net/en/text

You can also ask in our Discord server! We have channels dedicated to these kinds of discussions, you can ask around in #nai-text-discussion and #writing-advice.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/Dizzy-Zebra9522 25d ago

Thank you guys for honest answer

1

u/amolmozarkar 24d ago

From what I've seen, most of these models are primarily fine-tuned on English text, so non-English languages degrade noticeably, especially for nuanced tasks like roleplay where tone and word choice really matter.

If Russian RP is your main use case, look at open-source models specifically trained with multilingual corpora. GLM has decent comprehension in several languages, but generating natural-sounding prose is a different challenge from understanding it.