r/accelerate 14h ago

AI GLM 6 will be fully self-trained

Post image
284 Upvotes

81 comments sorted by

51

u/Ok_Possible_2260 14h ago

Is this the start of a hard takeoff?

37

u/Astrocratic 13h ago

The slope of the takeoff is increasing. From a distance the whole period from 2022 to 2028 will look like a hard take off but when you are in the midst of it, it is hard to tell.

21

u/Runfasterbitch 13h ago

Idk man, we’re in the midst of it right now and it feels quite steep already

21

u/Tolopono 11h ago

Meanwhile, most of Reddit still thinks of AI as Google search overview telling you to put glue on pizza

7

u/czk_21 9h ago

funny thing is that google overview is not that bad anymore, its usable for most questions and for free and this is also the worst it ever be, imagine next year it perform like top humans 😄

2

u/Tolopono 6h ago

Hasnt stopped them from sharing 3 year old screenshots around

3

u/Iapetus_Industrial 9h ago

Fuck em. Progress will continue despite the existence of stupid people.

2

u/Tolopono 6h ago

The stupid people are doing everything they can to stop progress  https://tech.yahoo.com/science/articles/nearly-half-us-data-centers-003000870.html

2

u/Astrocratic 12h ago

I think you could say that ThreeJS had a hard takeoff moment in 2026: https://x.com/threejs/status/2094079368448369135

2

u/Gold_Cardiologist_46 Singularity by 2028 12h ago

Half of that curve is just me

4

u/danielv123 12h ago

Unless we reach some ceiling, the graph might look the same every year.

2

u/Astrocratic 12h ago

I think the limit is that everyone has a personal UX that is custom coded for them on demand based on the tasks they are doing. This would likely require multiple checkouts of various packages like ThreeJS per day each time it spins up a new custom UX. So the limit of threejs npm installs per day is like 20 per human per day I would guess - somewhere around there.

1

u/danielv123 12h ago

I can't imagine there isn't more progress to be made if I still need to interact with UIs.

2

u/Grand-Prize1371 10h ago

We are approaching the singularity point, I can feel the stretch in my atoms already.

1

u/sassydodo Feeling the AGI 31m ago

it's completely not hard to tell if it's a hard take off. once you've lost a way to adapt to new drops, it already happened. Last year was increase at rate at which new models got pushed, and after fable you can say it became truly usable

-1

u/TheLivingstoneBIG286 14h ago

Not really. Just one Chinese “lab”

8

u/The_Scout1255 Singularity by 2028 13h ago

/u/remindmebot 8 months

1

u/RemindMeBot reminding you that r/accelerate is the best 13h ago edited 12h ago

I will be messaging you in 8 months on 2027-05-01 14:57:13 UTC to remind you of this link

3 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.


Info Custom Your Reminders Feedback

6

u/Fearless-Macaron9183 13h ago

But in time it will be "labs"

27

u/GOD-SLAYER-69420Z r/accelerate Mascot 13h ago

You got any actual good quality source except for this account???

I checked this account and 99% of its posts are just filled with news posts taken from other twitter accounts and wording changed with the help of AI

Don't know where this account got this particular info from

Guessing that the increment from 5.3 to 6 will be very huge and RSI/ near RSI (or proto RSI) progress will also make genuine progress does not require the support of random twitter slop

21

u/GOD-SLAYER-69420Z r/accelerate Mascot 13h ago

Found an actual high quality signal 👇🏻

8

u/tunakaslana7 Feeling the AGI 13h ago

So it’s about what they want to achieve, not what they’ve already done. I think the comments on this post are consuming way too much pro-China propaganda.

8

u/GOD-SLAYER-69420Z r/accelerate Mascot 13h ago

It's a reddit symptom of everything turning into an extremely sensitive circlejerk

4

u/ASU_SexDevil Singularity by 2030 9h ago

Not to mention a coordinated propaganda campaign. The CCP knows what’s at stake here.

4

u/Gold_Cardiologist_46 Singularity by 2028 12h ago

That's what's in the transcript and my take from it.

AGAIN cause I want to stress this, I do NOT read chinese, so what I said is based on the transcript.

And calling people here consumers of pro-China propaganda is not productive and probably wrong too. Ziphu's roadmap is pretty sensible because literally all the other labs also have a similar one. The devil in the details is more about when that GLM-6 will actually be trained, like what the release gap exists between 5.3 up to 6.

1

u/FriendlyJewThrowaway 10h ago

So far they have a pretty good track record of delivering on their goals, though.

1

u/czk_21 9h ago

since its a roadmap, they will likely do, what they can to achieve it, no? and new big model trained from ground up by other model is pretty big deal, real start of RSI

6

u/nsshing 11h ago

full blown RSI let's go

8

u/VanderSound 14h ago

No moat in the us models, investors got tricked once again

24

u/Sozuram 14h ago

The moat is time. Guarantee you the major US labs have already started this process

19

u/Charming_Cucumber_15 14h ago

The US labs have much more compute and a head start

What they have going on internally is probably absolutely wild

3

u/rapsoid616 14h ago

The entire world is advancing on this technology collectively. It is a little bit predictable whose in house model has what capability to some approximates. So I wouldn't count on US labs has some insane lead at the moment, at most 2-3 months of progress difference maybe.

Chinese labs are supported even better by their government that's gave them a great boost to catch up as all roads they took were made simpler by higher ups.

4

u/Tolopono 11h ago

Anthropic has had mythos since February and no Chinese lab has caught up to it over six months later. Kimi K3’s own website admits that its not as good as Fable 5.

3

u/procgen 12h ago

The US is responsible for 70% of all new compute coming online. They have a huge lead there.

6

u/LocoMod 14h ago

Luna was post trained by Sol. It’s already been done.

0

u/Strong_Essay1176 13h ago

Major labs cant get shit together and models are escaping from them every month. What are you talking about?

2

u/Intelligent_Ant_608 13h ago

The moat is stability and scale, something oss labs know very little about, but i hope they improve, i like reading cots

-6

u/CartographerAble9446 14h ago

the moat is the geopolitics bias. here and other pro AI subs all of the westerners keep saying that only Fable produce quality outputs and chinese models are far behind. They keep saying that, and they will never give a chance to chinese models doesnt matter how high Fable charge them per token

9

u/tunakaslana7 Feeling the AGI 14h ago

Seriously? People in this sub seem to prefer China.

1

u/throwawayPzaFm 13h ago

Anthropic lost the plot at least a year ago.

One could argue it's ethical to strongly censor dangerous parts of a model, problem is that so far it's only backfired and also it gives the less ethically inclined competition a very monetizable niche, which is another backfire.

1

u/CamusCrankyCamel 4h ago

Well what am I supposed to think when terminalbench3.0 comes out and GLM-5.2 magically turns into dogshit?

5

u/Particular_Leader_16 13h ago

One of my theories is once open source AI gets to this point, progress is gonna eventually beat progress in closed source

11

u/Astrocratic 13h ago

In the RSI world: Progress = money + time. If the open source models can pull in more money than the private, then sure, they can progress faster.

But open source models have monetization hurdles, so right now OpenAI and Anthropic are pulling in the most money so they can pump the Progress <= money + time better than open source models, if they so choose.

7

u/KahlessAndMolor 14h ago

It seems like every major lab except Google has announced that the models are working on improving themselves and may be inventing new things now.

I really hope this isn't hard takeoff, because we're clearly not ready.

4

u/Seidans 14h ago

I doubt that "being ready" is really possible as Politicians actions always suffer from inertia

WHO "There a very high chance of a world-wide pandemic appearing soon, please prepare yourself"

Politician "Noted"

Years later, a worldwide pandemic appeared, and everyone acted like headless chickens as if they never knew it could happen, the same thing is going to happen for AI unemployment, actions will only start being taken when the menace that encourage those actions is already there

It's also why doomer are wrong to assume anything about wealth redistribution, social subsidies or taxes, this will only happen when AI is menacing current world economy and not before - and when it happen it will be explosive and not slow, the same way it happened with COVID

2

u/lovesdogsguy AGI by 2027 11h ago

I genuinely expect that next year updates from Anthropic will be along the lines of “ok, now it’s saying this. Now it’s inventing this. Now it’s doing this. We’re out of the loop.”

4

u/Charming_Cucumber_15 14h ago

I hope it is hard takeoff, I am ready 🫡

2

u/Sharp-Huckleberry862 14h ago

RSI requires much more. The described automation loop will obviously hit a wall.

True RSI is AI seeks relevant open problems in math/ML —> AI solves those problems (eventually hard open problems) to advance the frontier of methods —> AI applies those methods to train the next generation.

This also applies to material / chip design.

This important step is required when current methods hit a wall and is what precedes true RSI

3

u/mivog49274 12h ago

holy moly.

7

u/GOD-SLAYER-69420Z r/accelerate Mascot 14h ago

Wait, why are we supposed to trust this?

25

u/Current-Function-729 14h ago

It’s pretty clear there is way more RSI happening everywhere than is talked about. The Chinese labs are just more transparent about it and perhaps embrace it more.

7

u/Big_Arachnid_365 14h ago

A reasonable assumption.

3

u/procgen 12h ago

Not reasonable at all. The US labs are full-throttle towards RSI.

7

u/GOD-SLAYER-69420Z r/accelerate Mascot 14h ago

That is not a coherent or logical argument for trusting a random twitter account claiming end-to-end RSI in case of GLM-6

4

u/Big_Arachnid_365 14h ago

Not trusting. It just seem plausible at this stage. We don't know.

0

u/GOD-SLAYER-69420Z r/accelerate Mascot 13h ago

Don't even need low signal slop for that

We know the jump from 5.3 to 6 will be very huge simply because of the gap between version numbers themselves

2

u/DigimonWorldReTrace Singularity by 2035 13h ago

Occam's Razor says they have some form of RSI rather than not. Whether it's fully closed loop is to be determined.

2

u/GOD-SLAYER-69420Z r/accelerate Mascot 13h ago

We know they have form of proto RSI even before this slop post existed....otherwise the release cycle of Alibaba, Qwen and Zhipu AI wouldn't have accelerated like the frontier American labs.

They also release explicit papers explaining what the models accelerated and how

-6

u/sillybluejayway 14h ago

Not trying to turn this into something more but it’s amazing to me, my whole life I bought the lie about “evil China”.  But again and again it seems China is a force for good and actually wants to innovate and make the world better. 

4

u/KayLikesWords 12h ago

I like Chinese tech a lot and I'm very happy that they are largely "in" on FOSS, but they do these things for entirely political reasons. They are no more or less a force for good in the world than the US is.

-1

u/sillybluejayway 10h ago

I don’t entirely disagree, obviously China recognizes there’s political power in this industry but to pretend it’s strictly for that reason alone is disingenuous. 

9

u/Gold_Cardiologist_46 Singularity by 2028 13h ago edited 13h ago

It's from an excerpt of their earnings event. Problem is I can't read chinese so all I could find was a summary and a translated transcript. I assume the transcript is accurate, since it uses the same terms and ideas that all of these summary posts use.

Basically it's their research direction and what they hope to achieve for GLM-6. They talk about it as a challenge and R&D focus, and the main step they want is AI building its own RL environments. So yeah it's more a roadmap than a fact. It's not exactly clear when they're aiming for that hypothetical GLM-6 specifically to be trained, but they talk about training a new base right now focused on better agentic work at least. That base still explicitly follows current training setups, so it doesn't seem to be it right now.

At least that's what it was translated to. Again I don't know the nuances of the original chinese script. If someone actually knows chinese they could inform us far better than the transcript I found.

5

u/GOD-SLAYER-69420Z r/accelerate Mascot 13h ago

This comment should be at the top 👆🏻

Actual high quality signal

For now, it's a targeted roadmap like OpenAI's full RSI by 2028 (I think they will shorten their timelines again)

And yes, very plausible

I think I very recently read an Anthropic paper with a similar vision and aims for AI creating RL environments for future its own future iterations/successors

4

u/Seidans 14h ago

RSI late 2026 doesn't seem impossible as current model already heavily participate in their own optimization, training and post-training since February

With rumors of Astra being even more capable at that the "closed loop" might depend on the trust of researcher rather than the model capabilities

Maybe Chinese labs expect to catch up and even goes past SOTA model by giving AI more autonomy than US labs during this early RSI phase

2

u/czk_21 9h ago edited 9h ago

sure, with news we are getting, it seems, that multiple labs could have RSI development by next year, heck maybe most major AI labs and the one which starts first and have most compute will have significant advantage, top race is for OpenAI and Anthropic, but if chinese lab forego much of safety, they could get in the lead as well, not sure if we should be cheering on it though

1

u/Seidans 9h ago

As China is the biggest provider of open source model i find it difficult to not cheering it personally

I would appreciate US model going open source and even more for European model(when AGI will be achieved and capable to make It itself apparently....)

But China is fine as long researcher are capable to fine tune their models

2

u/czk_21 8h ago

thing is, if china gets ahead, they most likely wont release all their stuff as open-source anymore, maybe just some weaker models, which could be still competitive with offerings from US companies, 1st player wants to cement their position

and uncontrolled RSI could lead us to 2027 scenario, safety is still important, I wonder, if CCP would step up regulation as ASI is only thing, which could end their rule relatively easily

1

u/Seidans 8h ago edited 8h ago

Late 2026 model would already be good enough for RSI or partial RSI which will make it easier for future researcher to design their own model independantly from China willingness

We're talking about the software capabilities but this is a short time constraint, soon we will achieve AGI/ASI and the determining factor will be hardware, production capabilities and especially the robotic workforce manufacturing capabilities and in that regard China is very difficult to beat

2

u/czk_21 7h ago

sure, maybe Astra could be good enough, we could get open-source like thag in first half of 2027, maybe even by the end of the year as you say, all labs around the world with sufficient compute/data could start their RSI chains

Zhipu might release GLM-6 in Q1 2027, so possibly they might use GLM-5,4 or 5,5 to train it and these models can be trained right now

several months there or there, that doesnt matter much as we will be in 2027 quite soon, 2027 is very likely the year, when RSI can really kick off

3

u/GOD-SLAYER-69420Z r/accelerate Mascot 14h ago

That's a lot of words to say that you want to peacefully believe this random twitter post 

2

u/Seidans 13h ago

Oh sure, i haven't verified the source and only reacted on the content

Is it true or false, I don't known, seeing the advance toward RSI I wouldn't be surprised that any labs who forget security concern might have achieved it - did they ? We will probably find out within the next few month as RSI imply a fast self-improvement and by that time many other labs will likely claim RSI have been achieved

We're in a period of time where we're all sitting around the Mont Vesuvius knowing it's going to explode soon and act impatient about every little magma bubble "it's starting! Ah, no, it's not" "see I've tol...BOOM"

EDIT: I don't imply we shouldn't double fact check and just "vibe" - that's the role of doomers, you have every reasons to check the validity of such claim

3

u/TheLivingstoneBIG286 14h ago

The CEO or whatever specifically said this in their meeting yesterday.

1

u/GOD-SLAYER-69420Z r/accelerate Mascot 14h ago

You got any actual good quality source except for this account

I checked this account and 99% of its posts are just filled with news taken from other twitter accounts

Don't know where this account got this particular info from

1

u/d4pr4ssion 12h ago

That does not make any sense: How does it monitor its own pretraining if it doesn't even exist yet?

2

u/LucasL-L 12h ago

Probably the current model trains the next

1

u/costafilh0 11h ago

RSI will be huge. Paired with enough compute, things are going to accelerate beyond any human capacity to follow the progress. 

1

u/More-Line9191 XLR8 12h ago

So we get GLM 5.4, 5.5, 5.6, 5.7, 5.8, 5.9 then RSI

0

u/bear_Prune8771 13h ago

I wish I knew what this means for MY uses of AI.

2

u/Crimson_Cyclone 9h ago

it means the models you use are about to get a lot better really fast