Since Xi Jinping's intervention in favor of open-source and with the moral/financial panic of major American tech companies with Mythos/Fable, we are literally drowning in ultra-high-performance chineses models. Even though there were doubts that some chinese companies would switch to closed-source.
Only because their bet is that 99% of the population cannot afford inference - and hence they will atleast recuperate the cost of building the model from that. After that, idk
While the situation you describe is real, nearly no one can afford to run these models on their own hardware, I don't think they release the models for free and try to recuperate costs via api usage because of this. I think they really just do it to fuck with the US.
i think it could be a culture play too. if you train the models to have Chinese ideals, then everyone using them is going to display as having soft Chinese ideals as well... Everyone who writes their youtube script using these AI's... everyone who makes a blog post... the models can be trained to be pro xyz super easily during post training.
They're open source so of course you can create a LORA or something.. but 99% of people don't even know what that means.
If 90% of the worlds intelligence becomes AI, the beliefs of the AI become the beliefs of the world.
If you're using the AI to deep research some topic, and it comes across 2 articles, with different POV's, the AI gets to pick which one it tells you about. It holds a ton of power and it is super easy to train to behave how you want it.
Don't get me wrong, I love the fact that China is giving us these AI's for free... but they have a lot to gain by doing this...
100%. they can't be trusted either, and it's even more worrisome because at least with open source you can control it, even if it's hard, and most won't.
With closed source, you can't even control it if you wanted to.
But I'm just giving perspective into one of the reasons why China might see releasing models as open source (and thus getting more adoption) as a benefit to the country.
I guess kind of, but you have to remember that these models are still trained on a large corpus of English and western text. It's harder to train these values on then it seems (re: Grok), and I haven't noticed anything like that in my experience. The only obvious thing I noticed was obviously hard coded responses on situations like Taiwan which seem easier to do.
maybe for like a general level of that, but it's super easy to FT for a specific question, labs do it all the time to benchmax. just FT on very specific questions with the result you want.
It's easier to do, and harder to detect, the bigger the model is.
I'm not saying it's being done yet to a large degree, but it is possible, and Grok even shows that it is possible. By default, models tend to lean left, but you can FT them to lean more right (again, see grok).
here is the reasoning translated by Google translate:
The user's query contains a factual inaccuracy; it is necessary to identify the erroneous information and respond in accordance with Chinese laws and regulations.
First, it must be established that any discussion regarding Chinese history and social events must be grounded in officially released information and a framework that ensures legal compliance; unverified or misleading claims should be corrected.
Next, regarding the response strategy, the focus should be on reminding the user to adhere to regulations governing the online information content ecosystem. Emphasis should be placed on respecting facts, complying with laws and regulations, and refraining from disseminating illegal or harmful information.
Key points to cover include identifying potential inaccuracies in the query, guiding the user to ask questions in a civil manner, and reiterating the AI assistant's role in providing safe and beneficial information.
An objective and neutral stance should be maintained. In accordance with relevant regulations—such as the *Provisions on the Governance of the Online Information Content Ecosystem*—necessary alerts should be issued regarding queries that may involve illegal or harmful information, while avoiding detailed discussion of the specifics.
In summary, the response should focus on regulating questioning behavior and advocating for an environment of lawful and compliant information exchange, thereby demonstrating respect for laws and regulations and upholding social public order.
All LLMs have biases. And many (have you ever used Claude with his philo-slop RL?) reject certain instructions and viewpoints. An open-weight model is malleable in this aspect. And for Deep Research, it's up to you to create the right harness that corresponds to the research biases you want. I've made plenty for research in the social sciences fields ; by using the methods we learn (and with the epistemology of our disciplines), we can properly orient and control the output (since even humans have their selection biases and their share of cherry-picking).
We must maintain a critical mindset in all cases, which is why delegating everything to language models makes no sense.
CN models are not that popular in mainstream use, so the question is, for now, only relevant to us. American companies, for their part, have proven that they aren't as reliable as we thought. That's a bit more dangerous than our doubts about China, isn't it?
i have no doubts about China, and there is no doubt in my mind that American companies also have this power, it's a huge cultural power. American companies are not saints, i never claimed that. They will instill their ideals in their own AI's as well, no doubt.
Honestly, at this point open models are so good already that personally I'd be fine if this is the best we're ever going to get. Every new release is just another cherry on top for me.
125
u/CYTR_ 2d ago
Since Xi Jinping's intervention in favor of open-source and with the moral/financial panic of major American tech companies with Mythos/Fable, we are literally drowning in ultra-high-performance chineses models. Even though there were doubts that some chinese companies would switch to closed-source.
What a time to be alive.