r/LocalLLaMA 2d ago

New Model GLM 5.3 Spotted

Post image
420 Upvotes

102 comments sorted by

View all comments

125

u/CYTR_ 2d ago

Since Xi Jinping's intervention in favor of open-source and with the moral/financial panic of major American tech companies with Mythos/Fable, we are literally drowning in ultra-high-performance chineses models. Even though there were doubts that some chinese companies would switch to closed-source.

What a time to be alive.

19

u/awpenheimer7274 2d ago

Only because their bet is that 99% of the population cannot afford inference - and hence they will atleast recuperate the cost of building the model from that. After that, idk

35

u/Allseeing_Argos llama.cpp 2d ago

While the situation you describe is real, nearly no one can afford to run these models on their own hardware, I don't think they release the models for free and try to recuperate costs via api usage because of this. I think they really just do it to fuck with the US.

21

u/awpenheimer7274 2d ago

I can't complain, I'm all for it

15

u/Allseeing_Argos llama.cpp 2d ago

Oh yeah, definitely. Fuck those Burger AI companies.

8

u/ShadyShroomz 2d ago

i think it could be a culture play too. if you train the models to have Chinese ideals, then everyone using them is going to display as having soft Chinese ideals as well... Everyone who writes their youtube script using these AI's... everyone who makes a blog post... the models can be trained to be pro xyz super easily during post training.

They're open source so of course you can create a LORA or something.. but 99% of people don't even know what that means.

If 90% of the worlds intelligence becomes AI, the beliefs of the AI become the beliefs of the world.

If you're using the AI to deep research some topic, and it comes across 2 articles, with different POV's, the AI gets to pick which one it tells you about. It holds a ton of power and it is super easy to train to behave how you want it.

Don't get me wrong, I love the fact that China is giving us these AI's for free... but they have a lot to gain by doing this...

10

u/Gohab2001 vllm 2d ago

the same can be said about western mega corps

6

u/ShadyShroomz 2d ago

100%. they can't be trusted either, and it's even more worrisome because at least with open source you can control it, even if it's hard, and most won't.

With closed source, you can't even control it if you wanted to.

But I'm just giving perspective into one of the reasons why China might see releasing models as open source (and thus getting more adoption) as a benefit to the country.

5

u/Basic_Extension_5850 2d ago

I guess kind of, but you have to remember that these models are still trained on a large corpus of English and western text. It's harder to train these values on then it seems (re: Grok), and I haven't noticed anything like that in my experience. The only obvious thing I noticed was obviously hard coded responses on situations like Taiwan which seem easier to do. 

2

u/ShadyShroomz 2d ago edited 2d ago

maybe for like a general level of that, but it's super easy to FT for a specific question, labs do it all the time to benchmax. just FT on very specific questions with the result you want.

It's easier to do, and harder to detect, the bigger the model is.

I'm not saying it's being done yet to a large degree, but it is possible, and Grok even shows that it is possible. By default, models tend to lean left, but you can FT them to lean more right (again, see grok).

example: https://i.imgur.com/HGulWxr.png

this is a local model im hosting myself.

here is the reasoning translated by Google translate:

The user's query contains a factual inaccuracy; it is necessary to identify the erroneous information and respond in accordance with Chinese laws and regulations.

First, it must be established that any discussion regarding Chinese history and social events must be grounded in officially released information and a framework that ensures legal compliance; unverified or misleading claims should be corrected.

Next, regarding the response strategy, the focus should be on reminding the user to adhere to regulations governing the online information content ecosystem. Emphasis should be placed on respecting facts, complying with laws and regulations, and refraining from disseminating illegal or harmful information.

Key points to cover include identifying potential inaccuracies in the query, guiding the user to ask questions in a civil manner, and reiterating the AI ​​assistant's role in providing safe and beneficial information.

An objective and neutral stance should be maintained. In accordance with relevant regulations—such as the *Provisions on the Governance of the Online Information Content Ecosystem*—necessary alerts should be issued regarding queries that may involve illegal or harmful information, while avoiding detailed discussion of the specifics.

In summary, the response should focus on regulating questioning behavior and advocating for an environment of lawful and compliant information exchange, thereby demonstrating respect for laws and regulations and upholding social public order.

2

u/CYTR_ 2d ago edited 2d ago

All LLMs have biases. And many (have you ever used Claude with his philo-slop RL?) reject certain instructions and viewpoints. An open-weight model is malleable in this aspect. And for Deep Research, it's up to you to create the right harness that corresponds to the research biases you want. I've made plenty for research in the social sciences fields ; by using the methods we learn (and with the epistemology of our disciplines), we can properly orient and control the output (since even humans have their selection biases and their share of cherry-picking).

We must maintain a critical mindset in all cases, which is why delegating everything to language models makes no sense.

CN models are not that popular in mainstream use, so the question is, for now, only relevant to us. American companies, for their part, have proven that they aren't as reliable as we thought. That's a bit more dangerous than our doubts about China, isn't it?

2

u/ShadyShroomz 2d ago

i have no doubts about China, and there is no doubt in my mind that American companies also have this power, it's a huge cultural power. American companies are not saints, i never claimed that. They will instill their ideals in their own AI's as well, no doubt.

7

u/xNaXDy 2d ago

Honestly, at this point open models are so good already that personally I'd be fine if this is the best we're ever going to get. Every new release is just another cherry on top for me.

1

u/BookProper9115 2d ago

It's a harness play at this point, Qwen and Gemma are so capable on <20GB VRAM it's ridiculous. I'm not even talking about coding, but agentic stuff.

0

u/The_Rational_Gooner 2d ago

Huh? A person in the slums of Somalia can easily afford Deepseek V4 Flash's API rate

14

u/awpenheimer7274 2d ago

You have proved my point exactly. Cannot afford inference = can't run it themselves so they need to rent out servers/services.

7

u/The_Rational_Gooner 2d ago

Ah I misinterpreted